Jul 11 17:47:23 devstack cinder-volume[75662]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 17:47:23 devstack cinder-volume[75662]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 17:47:23 devstack cinder-volume[75662]: we strongly recommend against using it for new projects. Jul 11 17:47:23 devstack cinder-volume[75662]: If you are already using Eventlet, we recommend migrating to a different Jul 11 17:47:23 devstack cinder-volume[75662]: framework. For more detail see Jul 11 17:47:23 devstack cinder-volume[75662]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 17:47:23 devstack cinder-volume[75662]: import eventlet # noqa Jul 11 17:47:26 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:47:26 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:47:26 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:47:27 devstack cinder-volume[75662]: INFO dbcounter [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Registered counter for database cinder Jul 11 17:47:27 devstack cinder-volume[75662]: DEBUG oslo_db.sqlalchemy.engines [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG dbcounter [-] [75662] Writer thread running {{(pid=75662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.rpc [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.rpc [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG oslo_db.sqlalchemy.engines [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.volume.manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Determined volume DB was empty at startup. Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG cinder.volume.manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75662) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.volume.manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 17:47:28 devstack cinder-volume[75662]: WARNING stevedore.named [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 17:47:28 devstack cinder-volume[75662]: WARNING castellan.key_manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:47:28 devstack cinder-volume[75662]: WARNING cinder.keymgr.conf_key_mgr [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG cinder.volume.drivers.lvm [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75662) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG oslo_concurrency.processutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG oslo_concurrency.processutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] CMD "cinder-rtstool verify" returned: 0 in 0.399s {{(pid=75662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG oslo_db.sqlalchemy.engines [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.rpc [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.rpc [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 11 17:47:28 devstack cinder-volume[75662]: WARNING stevedore.named [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 17:47:28 devstack cinder-volume[75662]: WARNING castellan.key_manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:47:28 devstack cinder-volume[75662]: INFO cinder.volume.manager [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 11 17:47:28 devstack cinder-volume[75662]: DEBUG oslo_db.sqlalchemy.engines [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:47:29 devstack cinder-volume[75662]: INFO oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Starting 1 workers Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Started child 75853 {{(pid=75662) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Full set of CONF: {{(pid=75662) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] ******************************************************************************** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Configuration options gathered from: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] ================================================================================ {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] allow_availability_zone_fallback = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] allow_compression_on_image_upload = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] allowed_direct_url_schemes = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75853]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] api_rate_limit = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] auth_strategy = keystone {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] az_cache_duration = 3600 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_availability_zone = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_host = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_stats_polling_interval = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backup_api_class = cinder.backup.api.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backup_name_template = backup-%s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backup_use_same_host = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backup_use_temp_snapshot = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] chap_password = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] chap_username = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_internal_tenant_project_id = 32c893a96ade4e95a52c7ac034762e3a {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_internal_tenant_user_id = 07c403de36c846c1b495221b146c7aec {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cloned_volume_same_az = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cluster = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] compression_format = gzip {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] compute_api_class = cinder.compute.nova.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] config_dir = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] config_source = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] control_exchange = openstack {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] debug = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] default_availability_zone = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] default_group_type = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] default_volume_type = lvmdriver-1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] disk_geometry = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_client_cert = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_client_cert_key = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_data_namespace = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_ssl_cert_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_ssl_cert_verify = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] driver_use_ssl = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] enable_force_upload = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] enable_new_services = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] enable_unsupported_driver = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] enforce_multipath_for_image_xfer = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] filter_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_api_insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_api_ssl_compression = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_ca_certificates_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_catalog_info = image:glance:publicURL {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_num_retries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance_request_timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] goodness_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] graceful_shutdown_timeout = 5 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] group_api_class = cinder.group.api.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] host = devstack {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_compress_on_upload = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_conversion_address_space_limit = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_conversion_cpu_limit = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_conversion_disable = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_upload_use_cinder_backend = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_upload_use_internal_tenant = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_volume_cache_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_volume_cache_max_count = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] image_volume_cache_max_size_gb = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] init_host_max_objects_retrieval = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] instance_format = [instance: %(uuid)s] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iscsi_target_flags = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iscsi_write_cache = on {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iser_helper = tgtadm {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iser_ip_address = 192.168.122.189 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iser_port = 3260 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_color = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_config_append = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_dir = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_options = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_rotate_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_rotate_interval_type = days {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] log_rotation_type = none {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75853]: INFO cinder.volume.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] max_age = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] max_logfile_count = 30 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] max_logfile_size_mb = 200 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] max_over_subscription_ratio = 20.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] message_reap_interval = 86400 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] message_ttl = 2592000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] migration_create_volume_timeout_secs = 300 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] monkey_patch = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] monkey_patch_modules = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] my_ip = 192.168.122.189 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] no_snapshot_gb_quota = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] num_iser_scan_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] num_shell_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] num_volume_device_scan_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] nvmeof_conn_info_version = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] nvmet_ns_id = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] nvmet_port_id = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_max_limit = 1000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_ext_list = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_listen_port = 8776 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_use_ssl = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] osapi_volume_workers = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] per_volume_size_limit = -1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] periodic_fuzzy_delay = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] periodic_interval = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] public_endpoint = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] publish_errors = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_backup_gigabytes = 1000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_backups = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_gigabytes = 1000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_groups = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_snapshots = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] quota_volumes = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] rate_limit_burst = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] rate_limit_except_level = CRITICAL {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] rate_limit_interval = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] reinit_driver_count = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] replication_device = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] report_discard_supported = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] report_interval = 120 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] reservation_clean_interval = 86400 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] reservation_expire = 86400 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] reserved_image_namespaces = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] reserved_percentage = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] rpc_response_timeout = 120 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] run_external_periodic_tasks = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] scst_target_driver = iscsi {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] scst_target_iqn_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_down_time = 720 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] shell_completion = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] snapshot_name_template = snapshot-%s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] snapshot_same_host = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] split_loggers = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] state_path = /opt/stack/data/cinder {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] storage_availability_zone = nova {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] storage_protocol = iSCSI {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] syslog_log_facility = LOG_USER {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_helper = lioadm {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_ip_address = 192.168.122.189 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_port = 3260 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_protocol = iscsi {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] target_secondary_ip_addresses = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] trace_flags = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] transport_url = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] until_refresh = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_chap_auth = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_default_quota_class = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_journal = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_json = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_multipath_for_image_xfer = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_stderr = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] use_syslog = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] verify_glance_signatures = enabled {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_api_class = cinder.volume.api.API {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_backend_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_clear = zero {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_clear_ionice = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_clear_size = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_copy_bps_limit = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_dd_blocksize = 1M {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_name_template = volume-%s {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_service_inithost_offload = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volume_usage_audit_period = month {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] zoning_mode = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_concurrency.disable_process_locking = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.auth_section = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.auth_type = password {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.auth_version = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.cache = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.include_service_catalog = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.interface = public {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_password = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcache_username = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.region_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.service_type = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.backend = dogpile.cache.null {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.backend_argument = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.backend_expiration_time = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.config_prefix = cache.oslo {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.debug_cache_backend = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.enable_retry_client = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.enable_socket_keepalive = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.expiration_time = 600 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.hashclient_retry_attempts = 2 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_dead_retry = 300 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_pool_maxsize = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_sasl_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.password = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.proxies = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.redis_db = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.redis_server = localhost:6379 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.retry_attempts = 2 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.retry_delay = 0.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.socket_keepalive_count = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.socket_keepalive_idle = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.socket_keepalive_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.socket_timeout = 1.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.tls_allowed_ciphers = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.tls_cafile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.tls_certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.tls_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.tls_keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cache.username = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] coordination.backend_url = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.asyncio_connection = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.asyncio_slave_connection = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.backend = sqlalchemy {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.connection = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.connection_debug = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.connection_parameters = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.connection_recycle_time = 3600 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.connection_trace = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.db_inc_retry_interval = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.db_max_retries = 20 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.db_max_retry_interval = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack sudo[75858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 11 17:47:29 devstack sudo[75858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.db_retry_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.max_overflow = 50 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.max_pool_size = 5 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.max_retries = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.mysql_wsrep_sync_wait = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.pool_timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.retry_interval = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.slave_connection = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.sqlite_synchronous = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.synchronous_reader = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] database.use_db_reconnect = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.connection_string = messaging:// {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.es_doc_type = notification {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.es_scroll_size = 10000 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.es_scroll_time = 2m {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.filter_error_trace = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.hmac_keys = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.sentinel_service_name = mymaster {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.socket_timeout = 0.1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.trace_requests = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler.trace_sqlalchemy = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler_jaeger.process_tags = {} {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler_jaeger.service_name_prefix = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] profiler_otlp.service_name_prefix = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.enforce_new_defaults = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.enforce_scope = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.policy_default_rule = default {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.policy_file = policy.yaml {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.group = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.helper_command = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] privsep_osbrick.user = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.group = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.helper_command = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] cinder_sys_admin.user = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.auth_section = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.auth_type = password {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.cafile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.collect_timing = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.send_service_user_token = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.split_loggers = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] service_user.timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.auth_section = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.auth_type = password {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.collect_timing = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.region_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.split_loggers = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] glance.timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.backend_availability_zone = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.chap_password = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.chap_username = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.disk_geometry = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_client_cert = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_client_cert_key = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_data_namespace = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.driver_use_ssl = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.extra_capabilities = {} {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.filter_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.goodness_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iscsi_target_flags = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iscsi_write_cache = on {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iser_helper = tgtadm {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iser_port = 3260 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.lvm_share_target = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.lvm_type = auto {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.num_shell_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.replication_device = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.report_discard_supported = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.reserved_percentage = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_helper = tgtadm {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_port = 3260 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_protocol = iscsi {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.trace_flags = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.unique_fqdn_network = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.use_chap_auth = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_backend_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_clear = zero {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_clear_ionice = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_clear_size = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_reports.file_event_handler = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_reports.log_dir = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.backend_host = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.chap_password = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.chap_username = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.disk_geometry = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_client_cert = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.extra_capabilities = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.filter_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.goodness_function = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iser_helper = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iser_ip_address = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iser_port = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.lvm_share_target = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.lvm_type = auto {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.num_shell_tries = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.replication_device = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.report_discard_supported = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.reserved_percentage = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.scst_target_driver = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.storage_protocol = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_helper = lioadm {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_ip_address = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_port = 3260 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.trace_flags = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.use_chap_auth = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_clear = zero {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_clear_size = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] lvmdriver-1.volumes_dir = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_notifications.driver = [] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_notifications.retry = -1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] key_manager.fixed_key = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.barbican_api_version = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.barbican_endpoint = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.barbican_endpoint_type = public {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.barbican_region_name = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.cafile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.collect_timing = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.number_of_retries = 60 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.retry_delay = 1 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.send_service_user_token = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.split_loggers = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.verify_ssl = True {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican.verify_ssl_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.auth_section = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.auth_type = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.cafile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.certfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.collect_timing = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.insecure = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.keyfile = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.split_loggers = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] barbican_service_user.timeout = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.approle_role_id = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.approle_secret_id = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.auth_method = approle {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.auth_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.kv_mountpoint = secret {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.kv_path = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.kv_version = 2 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.namespace = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.root_token_id = **** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.ssl_ca_crt_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.timeout = 60.0 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.token_file = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.token_role = None {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.use_ssl = False {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:47:29 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] ******************************************************************************** {{(pid=75662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 17:47:29 devstack sudo[75858]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:29 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:29 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:29 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:30 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:30 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.687s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:30 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 17:47:30 devstack cinder-volume[75853]: INFO cinder.brick.local_dev.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 11 17:47:30 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:30 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:30 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:30 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:30 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:31 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:31 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.790s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:31 devstack cinder-volume[75853]: DEBUG cinder.brick.local_dev.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75853) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 11 17:47:31 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:31 devstack sudo[76503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:31 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:32 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:32 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.046s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:32 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:32 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:32 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:32 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:32 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:33 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:33 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 11 17:47:33 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:33 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.680s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:33 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:33 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:33 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:34 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:34 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.852s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:34 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:34 devstack sudo[76651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:34 devstack sudo[76651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:35 devstack sudo[76651]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:35 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.861s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:35 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:35 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:35 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:36 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:36 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.783s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:36 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:36 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:36 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:37 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:37 devstack sudo[76668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:37 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:37 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.807s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:37 devstack cinder-volume[75853]: INFO cinder.volume.drivers.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:37 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:37 devstack sudo[76780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:37 devstack sudo[76780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:38 devstack sudo[76780]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:38 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:38 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:47:38 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:38 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:38 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:38 devstack cinder-volume[75662]: DEBUG dbcounter [-] [75662] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:47:39 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:39 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:39 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:39 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:39 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:39 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:39 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:39 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:39 devstack sudo[76939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:39 devstack sudo[76939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:40 devstack sudo[76939]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:40 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:40 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:40 devstack sudo[76943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:40 devstack sudo[76943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:41 devstack sudo[76943]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:41 devstack cinder-volume[75853]: INFO cinder.volume.driver [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG cinder.volume.driver [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75853) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG oslo_db.sqlalchemy.engines [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75853) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writer thread running {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG cinder.db.api [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Building query based on filter {{(pid=75853) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG cinder.image.image_utils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75853) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 17:47:41 devstack cinder-volume[75853]: INFO cinder.keymgr.migration [None req-03a117f5-bd6d-40cf-a464-79c39f1f45e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:41 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:41 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:41 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:41 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:41 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:41 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:42 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:42 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:42 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:42 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:42 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:43 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:43 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:43 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:43 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG cinder.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Notifying Schedulers of capabilities ... {{(pid=75853) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:47:43 devstack cinder-volume[75853]: INFO cinder.volume.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Driver initialization completed successfully. Jul 11 17:47:43 devstack cinder-volume[75853]: INFO cinder.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Initiating service 2 cleanup Jul 11 17:47:43 devstack cinder-volume[75853]: INFO cinder.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Service 2 cleanup completed. Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG cinder.service [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Creating RPC server for service cinder-volume {{(pid=75853) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG cinder.service [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75853) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 17:47:43 devstack cinder-volume[75853]: INFO cinder.volume.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:47:43 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:44 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:47:44 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:44 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:44 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:44 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:44 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:44 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:45 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:45 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:45 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:45 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:47:45 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:46 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:46 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:46 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:47:46 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:47:46 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:47:46 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Jul 11 17:47:46 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:47:46 devstack cinder-volume[75853]: INFO cinder.volume.manager [None req-459073d8-330b-4a4d-a721-77eef1364822 None None] Driver post RPC initialization completed successfully. Jul 11 17:47:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:47:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:48:24 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager._thread_info {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:48:24 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread count: 6 {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:48:24 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread info: [<_MainThread(MainThread, started 139511367364736)>, , , , , ] {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:49:24 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:49:24 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:49:24 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:49:24 devstack sudo[81903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:49:24 devstack sudo[81903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:49:25 devstack sudo[81903]: pam_unix(sudo:session): session closed for user root Jul 11 17:49:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:49:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:49:25 devstack sudo[81906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:49:25 devstack sudo[81906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:49:25 devstack sudo[81906]: pam_unix(sudo:session): session closed for user root Jul 11 17:49:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:49:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:49:25 devstack sudo[81909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:49:25 devstack sudo[81909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:49:26 devstack sudo[81909]: pam_unix(sudo:session): session closed for user root Jul 11 17:49:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:49:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:49:26 devstack sudo[81927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:49:26 devstack sudo[81927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:49:27 devstack sudo[81927]: pam_unix(sudo:session): session closed for user root Jul 11 17:49:27 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:49:27 devstack cinder-volume[75853]: DEBUG cinder.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Notifying Schedulers of capabilities ... {{(pid=75853) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:49:27 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager._thread_info {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:49:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread count: 6 {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:49:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread info: [<_MainThread(MainThread, started 139511367364736)>, , , , , ] {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:49:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:SELECT=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:49:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:UPDATE=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:50:24 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:50:24 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:50:24 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:50:24 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:50:24 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:50:25 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Jul 11 17:50:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:50:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:50:25 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:50:25 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:50:25 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Jul 11 17:50:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:50:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:50:26 devstack sudo[83632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:50:26 devstack sudo[83632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:50:26 devstack sudo[83632]: pam_unix(sudo:session): session closed for user root Jul 11 17:50:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:50:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:50:26 devstack sudo[83658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:50:26 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:50:27 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root Jul 11 17:50:27 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:50:27 devstack cinder-volume[75853]: DEBUG cinder.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Notifying Schedulers of capabilities ... {{(pid=75853) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:50:27 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager._thread_info {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:50:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread count: 6 {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:50:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread info: [<_MainThread(MainThread, started 139511367364736)>, , , , , ] {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:51:24 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:51:24 devstack cinder-volume[75853]: DEBUG cinder.volume.drivers.lvm [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Updating volume stats {{(pid=75853) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 17:51:24 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:51:24 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 17:51:24 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:51:25 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Jul 11 17:51:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:51:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:51:25 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:51:25 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:51:25 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Jul 11 17:51:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:51:25 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:51:25 devstack sudo[84998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 17:51:25 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:51:26 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root Jul 11 17:51:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:51:26 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:51:26 devstack sudo[85004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 17:51:26 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:51:27 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root Jul 11 17:51:27 devstack cinder-volume[75853]: DEBUG oslo_concurrency.processutils [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75853) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:51:27 devstack cinder-volume[75853]: DEBUG cinder.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Notifying Schedulers of capabilities ... {{(pid=75853) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:51:27 devstack cinder-volume[75853]: DEBUG oslo_service.periodic_task [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] Running periodic task VolumeManager._thread_info {{(pid=75853) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:51:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread count: 6 {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:51:27 devstack cinder-volume[75853]: DEBUG cinder.volume.manager [None req-8ae08e49-13cf-4336-b961-12492b3ac77f None None] thread info: [<_MainThread(MainThread, started 139511367364736)>, , , , , ] {{(pid=75853) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:51:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:SELECT=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:51:56 devstack cinder-volume[75853]: DEBUG dbcounter [-] [75853] Writing DB stats cinder:UPDATE=1 {{(pid=75853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:52:06 devstack cinder-volume[75662]: INFO oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Caught SIGTERM, stopping children Jul 11 17:52:06 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Acquiring lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:06 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Acquired lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:06 devstack cinder-volume[75662]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Releasing lock "singleton_lock" {{(pid=75662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:06 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Stop services. {{(pid=75662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 17:52:06 devstack cinder-volume[75662]: DEBUG oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Killing children. {{(pid=75662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 17:52:06 devstack cinder-volume[75662]: INFO oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Waiting on 1 children to exit Jul 11 17:52:08 devstack cinder-volume[75853]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Acquiring lock "singleton_lock" {{(pid=75853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:08 devstack cinder-volume[75853]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Acquired lock "singleton_lock" {{(pid=75853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:08 devstack cinder-volume[75853]: DEBUG oslo_concurrency.lockutils [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Releasing lock "singleton_lock" {{(pid=75853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:08 devstack cinder-volume[75853]: WARNING amqp [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 17:52:08 devstack cinder-volume[75853]: WARNING amqp [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 17:52:08 devstack cinder-volume[75662]: INFO oslo_service.backend._eventlet.service [None req-899e35db-ee6d-4d32-9f17-11e86bf7db12 None None] Child 75853 exited with status 0 Jul 11 17:52:09 devstack cinder-volume[85945]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 17:52:09 devstack cinder-volume[85945]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 17:52:09 devstack cinder-volume[85945]: we strongly recommend against using it for new projects. Jul 11 17:52:09 devstack cinder-volume[85945]: If you are already using Eventlet, we recommend migrating to a different Jul 11 17:52:09 devstack cinder-volume[85945]: framework. For more detail see Jul 11 17:52:09 devstack cinder-volume[85945]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 17:52:09 devstack cinder-volume[85945]: import eventlet # noqa Jul 11 17:52:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:11 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:12 devstack cinder-volume[85945]: INFO dbcounter [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Registered counter for database cinder Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_db.sqlalchemy.engines [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG dbcounter [-] [85945] Writer thread running {{(pid=85945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:52:12 devstack cinder-volume[85945]: INFO cinder.rpc [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 17:52:12 devstack cinder-volume[85945]: INFO cinder.rpc [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_db.sqlalchemy.engines [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Determined volume DB was empty at startup. Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG cinder.volume.manager [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85945) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 17:52:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 17:52:12 devstack cinder-volume[85945]: WARNING stevedore.named [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 17:52:12 devstack cinder-volume[85945]: WARNING castellan.key_manager [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:52:12 devstack cinder-volume[85945]: WARNING cinder.keymgr.conf_key_mgr [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:52:12 devstack cinder-volume[85945]: INFO cinder.volume.manager [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_db.sqlalchemy.engines [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:12 devstack cinder-volume[85945]: INFO oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Starting 1 workers Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Started child 86162 {{(pid=85945) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Full set of CONF: {{(pid=85945) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] ******************************************************************************** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Configuration options gathered from: {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] ================================================================================ {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 17:52:12 devstack cinder-volume[86162]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] allow_availability_zone_fallback = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] allow_compression_on_image_upload = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] allowed_direct_url_schemes = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] api_rate_limit = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] auth_strategy = keystone {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_availability_zone = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_host = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_stats_polling_interval = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backup_api_class = cinder.backup.api.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backup_name_template = backup-%s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backup_use_same_host = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backup_use_temp_snapshot = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] chap_password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] chap_username = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_internal_tenant_project_id = 32c893a96ade4e95a52c7ac034762e3a {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_internal_tenant_user_id = 07c403de36c846c1b495221b146c7aec {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cluster = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] compression_format = gzip {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] compute_api_class = cinder.compute.nova.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] config_dir = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] config_source = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] control_exchange = openstack {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] debug = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] default_availability_zone = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] default_group_type = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] default_volume_type = QuobyteHD {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] disk_geometry = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_client_cert = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_client_cert_key = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_data_namespace = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_ssl_cert_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_ssl_cert_verify = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] driver_use_ssl = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] enable_new_services = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] enable_unsupported_driver = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] enabled_backends = ['QuobyteHD'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] enforce_multipath_for_image_xfer = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] filter_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_api_insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_api_ssl_compression = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_ca_certificates_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[86162]: INFO cinder.volume.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_catalog_info = image:glance:publicURL {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.remotefs [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86162) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_num_retries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance_request_timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] goodness_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] graceful_shutdown_timeout = 5 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] group_api_class = cinder.group.api.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] host = devstack {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_compress_on_upload = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_conversion_address_space_limit = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_conversion_cpu_limit = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_conversion_disable = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_upload_use_cinder_backend = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_upload_use_internal_tenant = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_volume_cache_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_volume_cache_max_count = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] image_volume_cache_max_size_gb = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] init_host_max_objects_retrieval = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] instance_format = [instance: %(uuid)s] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iscsi_target_flags = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iscsi_write_cache = on {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iser_helper = tgtadm {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iser_ip_address = 192.168.122.189 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iser_port = 3260 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_color = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_config_append = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_dir = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_options = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_rotate_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_rotate_interval_type = days {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] log_rotation_type = none {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] max_age = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] max_logfile_count = 30 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] max_logfile_size_mb = 200 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] max_over_subscription_ratio = 20.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] message_reap_interval = 86400 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] message_ttl = 2592000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] migration_create_volume_timeout_secs = 300 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] monkey_patch = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] monkey_patch_modules = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] my_ip = 192.168.122.189 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] no_snapshot_gb_quota = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] num_iser_scan_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] num_shell_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] num_volume_device_scan_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] nvmeof_conn_info_version = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] nvmet_ns_id = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] nvmet_port_id = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_max_limit = 1000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_ext_list = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_listen_port = 8776 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_use_ssl = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] osapi_volume_workers = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] per_volume_size_limit = -1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] periodic_fuzzy_delay = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] periodic_interval = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] public_endpoint = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] publish_errors = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_backup_gigabytes = 1000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_backups = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_gigabytes = 1000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_groups = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_snapshots = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] quota_volumes = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] rate_limit_burst = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] rate_limit_except_level = CRITICAL {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] rate_limit_interval = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] reinit_driver_count = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] replication_device = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] report_discard_supported = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] report_interval = 120 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] reservation_clean_interval = 86400 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] reservation_expire = 86400 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] reserved_image_namespaces = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86162) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] reserved_percentage = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] rpc_response_timeout = 120 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] run_external_periodic_tasks = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] scst_target_driver = iscsi {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] scst_target_iqn_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[86162]: WARNING cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 17:52:12 devstack cinder-volume[86162]: WARNING cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 17:52:12 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Running cmd (subprocess): mount.quobyte {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_down_time = 720 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] shell_completion = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] snapshot_name_template = snapshot-%s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] split_loggers = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] state_path = /opt/stack/data/cinder {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] storage_availability_zone = nova {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] storage_protocol = iSCSI {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] syslog_log_facility = LOG_USER {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_helper = lioadm {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_ip_address = 192.168.122.189 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_port = 3260 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_protocol = iscsi {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] target_secondary_ip_addresses = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] trace_flags = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] transport_url = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] until_refresh = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_chap_auth = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_default_quota_class = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_journal = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_json = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_multipath_for_image_xfer = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_stderr = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] use_syslog = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] verify_glance_signatures = enabled {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_api_class = cinder.volume.api.API {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_backend_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_clear = zero {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_clear_ionice = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_clear_size = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_copy_bps_limit = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_dd_blocksize = 1M {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_name_template = volume-%s {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_service_inithost_offload = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volume_usage_audit_period = month {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] zoning_mode = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_concurrency.disable_process_locking = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.auth_section = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.auth_type = password {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.auth_version = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.cache = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.include_service_catalog = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.interface = public {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_password = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcache_username = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.region_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.service_type = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.backend = dogpile.cache.null {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.backend_argument = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.backend_expiration_time = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.config_prefix = cache.oslo {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.debug_cache_backend = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.enable_retry_client = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.enable_socket_keepalive = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.expiration_time = 600 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.hashclient_retry_attempts = 2 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_dead_retry = 300 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_pool_maxsize = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_sasl_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.proxies = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.redis_db = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.redis_server = localhost:6379 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.retry_attempts = 2 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.retry_delay = 0.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.socket_keepalive_count = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.socket_keepalive_idle = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.socket_keepalive_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.socket_timeout = 1.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.tls_allowed_ciphers = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.tls_cafile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.tls_certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.tls_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.tls_keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cache.username = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] coordination.backend_url = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.asyncio_connection = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.asyncio_slave_connection = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:12 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.backend = sqlalchemy {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.connection = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.connection_debug = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.connection_parameters = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.connection_recycle_time = 3600 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.connection_trace = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.db_inc_retry_interval = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.db_max_retries = 20 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.db_max_retry_interval = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.db_retry_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.max_overflow = 50 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.max_pool_size = 5 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.max_retries = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.mysql_wsrep_sync_wait = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.pool_timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.retry_interval = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.slave_connection = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.sqlite_synchronous = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.synchronous_reader = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] database.use_db_reconnect = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.connection_string = messaging:// {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.es_doc_type = notification {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.es_scroll_size = 10000 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.es_scroll_time = 2m {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.filter_error_trace = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.hmac_keys = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.sentinel_service_name = mymaster {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.socket_timeout = 0.1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.trace_requests = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler.trace_sqlalchemy = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler_jaeger.process_tags = {} {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler_jaeger.service_name_prefix = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] profiler_otlp.service_name_prefix = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.enforce_new_defaults = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.enforce_scope = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.policy_default_rule = default {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.policy_file = policy.yaml {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.group = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.helper_command = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] privsep_osbrick.user = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.group = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.helper_command = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] cinder_sys_admin.user = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.auth_section = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.auth_type = password {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.cafile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.collect_timing = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.send_service_user_token = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.split_loggers = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] service_user.timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.auth_section = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.auth_type = password {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.collect_timing = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.region_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.split_loggers = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] glance.timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.backend_availability_zone = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.chap_password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.chap_username = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.disk_geometry = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_client_cert = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_client_cert_key = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_data_namespace = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.driver_use_ssl = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.extra_capabilities = {} {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.filter_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.goodness_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iscsi_target_flags = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iscsi_write_cache = on {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iser_helper = tgtadm {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iser_port = 3260 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_host = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_login = admin {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_mount_options = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_private_key = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_share_path = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.num_shell_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.quobyte_volume_url = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.replication_device = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.report_discard_supported = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.reserved_percentage = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_helper = tgtadm {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_port = 3260 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_protocol = iscsi {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.trace_flags = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.unique_fqdn_network = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.use_chap_auth = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_backend_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_clear = zero {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_clear_ionice = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_clear_size = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_reports.file_event_handler = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] CMD "mount.quobyte" returned: 1 in 0.170s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86162) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:13 devstack cinder-volume[86162]: INFO cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae ... Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_reports.log_dir = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.backend_availability_zone = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.backend_host = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a -c /etc/quobyte/client-cinder.cfg {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.chap_password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.chap_username = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.chiscsi_conf = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.disk_geometry = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_client_cert = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_data_namespace = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.driver_use_ssl = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.extra_capabilities = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.filter_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.goodness_function = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iser_helper = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iser_ip_address = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iser_port = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.iser_target_prefix = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_host = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_login = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_mount_options = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_password = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_private_key = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_share_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_ssh_port = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.num_shell_tries = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.nvmet_port_id = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.replication_device = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.report_discard_supported = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.reserved_percentage = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.scst_target_driver = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.storage_protocol = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_helper = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_ip_address = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_port = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_prefix = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_protocol = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.trace_flags = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.use_chap_auth = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_clear = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_clear_size = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] QuobyteHD.volumes_dir = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_notifications.driver = [] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_notifications.retry = -1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] key_manager.fixed_key = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.barbican_api_version = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.barbican_endpoint = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.barbican_endpoint_type = public {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.barbican_region_name = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.cafile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.collect_timing = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.number_of_retries = 60 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.retry_delay = 1 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.send_service_user_token = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.split_loggers = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.verify_ssl = True {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican.verify_ssl_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.auth_section = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.auth_type = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.cafile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.certfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.collect_timing = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.insecure = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a -c /etc/quobyte/client-cinder.cfg Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.keyfile = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.split_loggers = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] barbican_service_user.timeout = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.approle_role_id = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.approle_secret_id = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.auth_method = approle {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.auth_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.kv_mountpoint = secret {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.kv_path = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.kv_version = 2 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.namespace = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.root_token_id = **** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.ssl_ca_crt_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.timeout = 60.0 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.token_file = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.token_role = None {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.use_ssl = False {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:13 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] ******************************************************************************** {{(pid=85945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 17:52:13 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.800s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:13 devstack cinder-volume[86162]: INFO cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae succeeded Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86162) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.811s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:13 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:13 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:13 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:14 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.658s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:14 devstack cinder-volume[86162]: INFO cinder.volume.driver [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Driver hasn't implemented _init_vendor_properties() Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG cinder.volume.driver [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86162) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_db.sqlalchemy.engines [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG dbcounter [-] [86162] Writer thread running {{(pid=86162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG cinder.db.api [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Building query based on filter {{(pid=86162) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG cinder.image.image_utils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86162) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 17:52:14 devstack cinder-volume[86162]: INFO cinder.keymgr.migration [None req-7302ec34-ab0b-4518-b1a6-20de10a9a71a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86162) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86162) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:14 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:14 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:14 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:15 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.664s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG cinder.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Notifying Schedulers of capabilities ... {{(pid=86162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:52:15 devstack cinder-volume[86162]: INFO cinder.volume.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Driver initialization completed successfully. Jul 11 17:52:15 devstack cinder-volume[86162]: INFO cinder.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Initiating service 3 cleanup Jul 11 17:52:15 devstack cinder-volume[86162]: INFO cinder.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Service 3 cleanup completed. Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG cinder.service [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Creating RPC server for service cinder-volume {{(pid=86162) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG cinder.service [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86162) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 17:52:15 devstack cinder-volume[86162]: INFO cinder.volume.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86162) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86162) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:15 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:15 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:15 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:16 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:16 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.908s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:16 devstack cinder-volume[86162]: INFO cinder.volume.manager [None req-94b64415-c721-4611-ba70-a0b8ca5f125a None None] Driver post RPC initialization completed successfully. Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86162) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86162) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86162) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:20 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:20 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:20 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:21 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:21 devstack cinder-volume[86162]: DEBUG oslo_concurrency.processutils [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.616s {{(pid=86162) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:21 devstack cinder-volume[86162]: DEBUG cinder.manager [None req-3e6ef0c8-a70f-4529-a5cd-e7ca4de70fab None None] Notifying Schedulers of capabilities ... {{(pid=86162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:52:22 devstack cinder-volume[85945]: INFO oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Caught SIGTERM, stopping children Jul 11 17:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Acquiring lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Acquired lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:22 devstack cinder-volume[85945]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Releasing lock "singleton_lock" {{(pid=85945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:22 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Stop services. {{(pid=85945) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 17:52:22 devstack cinder-volume[85945]: DEBUG oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Killing children. {{(pid=85945) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 17:52:22 devstack cinder-volume[85945]: INFO oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Waiting on 1 children to exit Jul 11 17:52:23 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Acquiring lock "singleton_lock" {{(pid=86162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:23 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Acquired lock "singleton_lock" {{(pid=86162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:23 devstack cinder-volume[86162]: DEBUG oslo_concurrency.lockutils [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Releasing lock "singleton_lock" {{(pid=86162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:23 devstack cinder-volume[86162]: WARNING amqp [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 17:52:23 devstack cinder-volume[86162]: WARNING amqp [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 17:52:23 devstack cinder-volume[85945]: INFO oslo_service.backend._eventlet.service [None req-a4bbd004-6b13-4ca3-ad77-ad02b7964818 None None] Child 86162 exited with status 0 Jul 11 17:52:24 devstack cinder-volume[86610]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 17:52:24 devstack cinder-volume[86610]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 17:52:24 devstack cinder-volume[86610]: we strongly recommend against using it for new projects. Jul 11 17:52:24 devstack cinder-volume[86610]: If you are already using Eventlet, we recommend migrating to a different Jul 11 17:52:24 devstack cinder-volume[86610]: framework. For more detail see Jul 11 17:52:24 devstack cinder-volume[86610]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 17:52:24 devstack cinder-volume[86610]: import eventlet # noqa Jul 11 17:52:27 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 17:52:27 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 17:52:27 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 17:52:28 devstack cinder-volume[86610]: INFO dbcounter [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Registered counter for database cinder Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_db.sqlalchemy.engines [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG dbcounter [-] [86610] Writer thread running {{(pid=86610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:52:28 devstack cinder-volume[86610]: INFO cinder.rpc [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 17:52:28 devstack cinder-volume[86610]: INFO cinder.rpc [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_db.sqlalchemy.engines [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:28 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Determined volume DB was empty at startup. Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG cinder.volume.manager [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86610) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 17:52:28 devstack cinder-volume[86610]: WARNING stevedore.named [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 17:52:28 devstack cinder-volume[86610]: WARNING castellan.key_manager [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:52:28 devstack cinder-volume[86610]: WARNING cinder.keymgr.conf_key_mgr [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 17:52:28 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_db.sqlalchemy.engines [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:28 devstack cinder-volume[86610]: INFO oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Starting 1 workers Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Started child 86932 {{(pid=86610) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Full set of CONF: {{(pid=86610) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] ******************************************************************************** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] Configuration options gathered from: {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 17:52:28 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] ================================================================================ {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 17:52:28 devstack cinder-volume[86932]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] allow_availability_zone_fallback = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] allow_compression_on_image_upload = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] allowed_direct_url_schemes = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] api_rate_limit = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] auth_strategy = keystone {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_availability_zone = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_host = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_stats_polling_interval = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backup_api_class = cinder.backup.api.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backup_name_template = backup-%s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backup_use_same_host = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backup_use_temp_snapshot = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] chap_password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] chap_username = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_internal_tenant_project_id = 32c893a96ade4e95a52c7ac034762e3a {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_internal_tenant_user_id = 07c403de36c846c1b495221b146c7aec {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cluster = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] compression_format = gzip {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] config_dir = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] config_source = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] control_exchange = openstack {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] debug = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] default_availability_zone = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] default_group_type = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] default_volume_type = QuobyteHD {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] disk_geometry = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_client_cert = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_client_cert_key = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_data_namespace = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_ssl_cert_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_ssl_cert_verify = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] driver_use_ssl = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] enable_new_services = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] enable_unsupported_driver = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] enforce_multipath_for_image_xfer = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] filter_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_api_insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_api_ssl_compression = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_ca_certificates_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_num_retries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance_request_timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] goodness_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] graceful_shutdown_timeout = 5 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] group_api_class = cinder.group.api.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] host = devstack {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_compress_on_upload = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_conversion_address_space_limit = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_conversion_cpu_limit = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_conversion_disable = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_upload_use_cinder_backend = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_upload_use_internal_tenant = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_volume_cache_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_volume_cache_max_count = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] init_host_max_objects_retrieval = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] instance_format = [instance: %(uuid)s] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iscsi_target_flags = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iscsi_write_cache = on {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iser_helper = tgtadm {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iser_ip_address = 192.168.122.189 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iser_port = 3260 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_color = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_config_append = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_dir = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_options = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_rotate_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_rotate_interval_type = days {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] log_rotation_type = none {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] max_age = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] max_logfile_count = 30 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] max_logfile_size_mb = 200 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] max_over_subscription_ratio = 20.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] message_reap_interval = 86400 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] message_ttl = 2592000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] monkey_patch = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] monkey_patch_modules = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] my_ip = 192.168.122.189 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] no_snapshot_gb_quota = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] num_iser_scan_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] num_shell_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] num_volume_device_scan_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] nvmeof_conn_info_version = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] nvmet_ns_id = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] nvmet_port_id = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_max_limit = 1000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_ext_list = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_listen_port = 8776 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_use_ssl = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] osapi_volume_workers = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] per_volume_size_limit = -1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] periodic_fuzzy_delay = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] periodic_interval = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 17:52:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86932) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 17:52:29 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] public_endpoint = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] publish_errors = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_backup_gigabytes = 1000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_backups = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_gigabytes = 1000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_groups = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_snapshots = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] quota_volumes = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] rate_limit_burst = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] rate_limit_except_level = CRITICAL {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] rate_limit_interval = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] reinit_driver_count = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] replication_device = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] report_discard_supported = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] report_interval = 120 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] reservation_clean_interval = 86400 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] reservation_expire = 86400 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] reserved_image_namespaces = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] reserved_percentage = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] rpc_response_timeout = 120 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] run_external_periodic_tasks = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] scst_target_driver = iscsi {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] scst_target_iqn_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_down_time = 720 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] shell_completion = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] snapshot_name_template = snapshot-%s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] split_loggers = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] state_path = /opt/stack/data/cinder {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] storage_availability_zone = nova {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] storage_protocol = iSCSI {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] syslog_log_facility = LOG_USER {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_helper = lioadm {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_ip_address = 192.168.122.189 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_port = 3260 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_protocol = iscsi {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] target_secondary_ip_addresses = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] trace_flags = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] transport_url = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] until_refresh = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_chap_auth = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_default_quota_class = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_journal = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_json = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_multipath_for_image_xfer = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_stderr = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] use_syslog = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] verify_glance_signatures = enabled {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_api_class = cinder.volume.api.API {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_backend_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_clear = zero {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_clear_ionice = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_clear_size = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_copy_bps_limit = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_dd_blocksize = 1M {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_name_template = volume-%s {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_service_inithost_offload = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volume_usage_audit_period = month {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] zoning_mode = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.auth_section = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.auth_type = password {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.auth_version = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.cache = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.interface = public {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_password = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcache_username = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.region_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.service_type = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.backend = dogpile.cache.null {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.backend_argument = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.backend_expiration_time = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.config_prefix = cache.oslo {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.debug_cache_backend = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.enable_retry_client = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.enable_socket_keepalive = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.expiration_time = 600 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86932) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 17:52:29 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_dead_retry = 300 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_sasl_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 17:52:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Running cmd (subprocess): mount.quobyte {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.proxies = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.redis_db = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.redis_server = localhost:6379 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.retry_attempts = 2 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.retry_delay = 0.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.socket_keepalive_count = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.socket_keepalive_idle = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.socket_keepalive_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.socket_timeout = 1.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.tls_allowed_ciphers = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.tls_cafile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.tls_certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.tls_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.tls_keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cache.username = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:29 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] coordination.backend_url = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.asyncio_connection = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.asyncio_slave_connection = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.backend = sqlalchemy {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.connection = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.connection_debug = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.connection_parameters = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.connection_recycle_time = 3600 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.connection_trace = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.db_inc_retry_interval = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.db_max_retries = 20 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.db_max_retry_interval = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.db_retry_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.max_overflow = 50 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.max_pool_size = 5 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.max_retries = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.pool_timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.retry_interval = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.slave_connection = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.sqlite_synchronous = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.synchronous_reader = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] database.use_db_reconnect = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.connection_string = messaging:// {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.es_doc_type = notification {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.es_scroll_size = 10000 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.es_scroll_time = 2m {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.filter_error_trace = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.hmac_keys = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.sentinel_service_name = mymaster {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.socket_timeout = 0.1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.trace_requests = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler.trace_sqlalchemy = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler_jaeger.process_tags = {} {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] profiler_otlp.service_name_prefix = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.enforce_scope = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.policy_default_rule = default {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.group = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.helper_command = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] privsep_osbrick.user = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.group = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.helper_command = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] cinder_sys_admin.user = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.auth_section = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.auth_type = password {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.cafile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.collect_timing = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.send_service_user_token = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.split_loggers = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] service_user.timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.auth_section = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.auth_type = password {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.collect_timing = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.region_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.split_loggers = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] glance.timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.backend_availability_zone = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.chap_password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.chap_username = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] CMD "mount.quobyte" returned: 1 in 0.168s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.disk_geometry = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_client_cert = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_data_namespace = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.driver_use_ssl = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.extra_capabilities = {} {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.filter_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.goodness_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iscsi_target_flags = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iser_port = 3260 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_host = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_login = admin {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_mount_options = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_private_key = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_share_path = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.replication_device = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.report_discard_supported = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_helper = tgtadm {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_port = 3260 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_protocol = iscsi {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.trace_flags = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.use_chap_auth = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_backend_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_clear = zero {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_reports.file_event_handler = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_reports.log_dir = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.backend_host = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.chap_password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.chap_username = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.disk_geometry = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_client_cert = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.extra_capabilities = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.filter_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.goodness_function = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iser_helper = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iser_ip_address = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iser_port = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_host = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_login = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_mount_options = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_password = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_private_key = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_share_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.num_shell_tries = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.replication_device = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.report_discard_supported = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.reserved_percentage = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.scst_target_driver = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.storage_protocol = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_helper = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_ip_address = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_port = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_prefix = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_protocol = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.trace_flags = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.use_chap_auth = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_clear = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_clear_size = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] QuobyteHD.volumes_dir = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_notifications.driver = [] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] key_manager.fixed_key = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.barbican_api_version = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.barbican_endpoint = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.barbican_endpoint_type = public {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.barbican_region_name = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.cafile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.collect_timing = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.number_of_retries = 60 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.retry_delay = 1 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.send_service_user_token = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.split_loggers = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.verify_ssl = True {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican.verify_ssl_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.auth_section = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.auth_type = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.cafile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.certfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.collect_timing = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.insecure = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.keyfile = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.split_loggers = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] barbican_service_user.timeout = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.approle_role_id = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.approle_secret_id = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.auth_method = approle {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.auth_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.kv_mountpoint = secret {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.kv_path = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.kv_version = 2 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.namespace = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.root_token_id = **** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.ssl_ca_crt_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.timeout = 60.0 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.token_file = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.token_role = None {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.use_ssl = False {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 17:52:30 devstack cinder-volume[86610]: DEBUG oslo_service.backend._eventlet.service [None req-3fad63ad-f84e-4075-85ca-2af45cef21e5 None None] ******************************************************************************** {{(pid=86610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 17:52:30 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.137s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:30 devstack cinder-volume[86932]: INFO cinder.volume.driver [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Driver hasn't implemented _init_vendor_properties() Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.volume.driver [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86932) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_db.sqlalchemy.engines [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writer thread running {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.db.api [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Building query based on filter {{(pid=86932) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86932) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:30 devstack cinder-volume[86932]: INFO cinder.keymgr.migration [None req-d19c7c50-f215-4576-b54d-523c8c7fbdf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 17:52:30 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:30 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:31 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.623s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:52:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Driver initialization completed successfully. Jul 11 17:52:31 devstack cinder-volume[86932]: INFO cinder.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Initiating service 3 cleanup Jul 11 17:52:31 devstack cinder-volume[86932]: INFO cinder.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Service 3 cleanup completed. Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG cinder.service [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Creating RPC server for service cinder-volume {{(pid=86932) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG cinder.service [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86932) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 17:52:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:52:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:52:31 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:52:31 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:52:32 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Jul 11 17:52:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.621s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:52:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-25fa7969-64f0-4d68-9cb5-41eaf9c5a5df None None] Driver post RPC initialization completed successfully. Jul 11 17:52:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:52:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 6 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:52:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:52:38 devstack cinder-volume[86610]: DEBUG dbcounter [-] [86610] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:52:41 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:52:42 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Flow 'volume_create_manager' (cfc84129-7137-4462-8bb3-ead81e105444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd865b3-9420-4228-a657-de90db2a0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd865b3-9420-4228-a657-de90db2a0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2060875963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf8ec5-7349-4f49-84a9-0236b9f269b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de00c975d4849b7880a4bf5ce5626db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:53:30Z,use_quota=True,user_id='36bcc6c25b024813b8c3c8c2284ef355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d624777d-35b5-4429-b9de-e7bcc31bdf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d624777d-35b5-4429-b9de-e7bcc31bdf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da0606c-ea9c-424b-8712-a3eb2a006d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da0606c-ea9c-424b-8712-a3eb2a006d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcf8ec5-7349-4f49-84a9-0236b9f269b3', 'volume_name': 'volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a87b7d-c112-4052-893d-22bd6abd0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a87b7d-c112-4052-893d-22bd6abd0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f736a088-5f22-47e6-8273-5080fba70131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Volume 3dcf8ec5-7349-4f49-84a9-0236b9f269b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3', 'volume_size': 1} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2060875963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf8ec5-7349-4f49-84a9-0236b9f269b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de00c975d4849b7880a4bf5ce5626db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:53:30Z,use_quota=True,user_id='36bcc6c25b024813b8c3c8c2284ef355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Creating volume 3dcf8ec5-7349-4f49-84a9-0236b9f269b3 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:53:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:53:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:53:30 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 1073741824 Jul 11 17:53:30 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:53:31 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Jul 11 17:53:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 1073741824" returned: 0 in 1.250s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:53:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:53:31 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 Jul 11 17:53:31 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:53:32 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" returned: 0 in 0.910s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f736a088-5f22-47e6-8273-5080fba70131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78310152-08fc-4880-b641-826783a9a396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:53:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Volume volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 (3dcf8ec5-7349-4f49-84a9-0236b9f269b3): created successfully Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78310152-08fc-4880-b641-826783a9a396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:53:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Flow 'volume_create_manager' (cfc84129-7137-4462-8bb3-ead81e105444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:53:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ec4a9a26-fefe-4f76-9114-f0c04391e16c tempest-TaggedAttachmentsTest-1618919230 None] Created volume successfully. Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:53:34 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:53:34 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:53:34 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.859s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 6 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:53:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:53:42 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:53:42 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Flow 'volume_create_manager' (cc2c6191-25c7-43bb-9f8f-67841dacecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89066db7-88fb-499c-9514-2da8a92fcaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89066db7-88fb-499c-9514-2da8a92fcaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-657370722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164e4872-adbe-46c3-9e4e-511a20230819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2943b0d44b48ab82614e48c47c97d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:03Z,use_quota=True,user_id='b1c9e486315846739d087bd202bf4c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae7bdd0-ba38-47f7-8fa3-1666e72e6b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae7bdd0-ba38-47f7-8fa3-1666e72e6b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbbf28e-eccd-4276-961d-2328e5ed44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbbf28e-eccd-4276-961d-2328e5ed44d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164e4872-adbe-46c3-9e4e-511a20230819', 'volume_name': 'volume-164e4872-adbe-46c3-9e4e-511a20230819', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77393716-cb24-4a00-978e-53526182b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77393716-cb24-4a00-978e-53526182b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315a2fc6-2523-4427-b710-cb26533e3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Volume 164e4872-adbe-46c3-9e4e-511a20230819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164e4872-adbe-46c3-9e4e-511a20230819', 'volume_size': 1} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-657370722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164e4872-adbe-46c3-9e4e-511a20230819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2943b0d44b48ab82614e48c47c97d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:03Z,use_quota=True,user_id='b1c9e486315846739d087bd202bf4c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Creating volume 164e4872-adbe-46c3-9e4e-511a20230819 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:54:03 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:54:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:03 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 1073741824 Jul 11 17:54:03 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:05 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 1073741824" returned: 0 in 2.056s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:05 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 Jul 11 17:54:05 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:07 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819" returned: 0 in 1.419s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] <== create_volume: return (3556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.562s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315a2fc6-2523-4427-b710-cb26533e3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164e4872-adbe-46c3-9e4e-511a20230819', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0094c274-9c22-4533-8a13-fabdffbf6464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Volume volume-164e4872-adbe-46c3-9e4e-511a20230819 (164e4872-adbe-46c3-9e4e-511a20230819): created successfully Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0094c274-9c22-4533-8a13-fabdffbf6464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Flow 'volume_create_manager' (cc2c6191-25c7-43bb-9f8f-67841dacecd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:54:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6da6a9fb-f4de-4f4c-86bf-7d328f232088 tempest-VolumesAdminNegativeTest-1044910382 None] Created volume successfully. Jul 11 17:54:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Acquiring lock "cinder-164e4872-adbe-46c3-9e4e-511a20230819-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:54:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "cinder-164e4872-adbe-46c3-9e4e-511a20230819-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:54:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Acquiring lock "cinder-quobyte-164e4872-adbe-46c3-9e4e-511a20230819" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:54:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "cinder-quobyte-164e4872-adbe-46c3-9e4e-511a20230819" acquired by "delete_volume" :: waited 0.063s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:54:08 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpspfku_1s/privsep.sock'] Jul 11 17:54:08 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpspfku_1s/privsep.sock Jul 11 17:54:08 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 17:54:09 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 17:54:10 devstack cinder-volume[86932]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 11 17:54:11 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:11 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Spawned new privsep daemon via rootwrap Jul 11 17:54:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Accepted privsep connection to /tmp/tmpspfku_1s/privsep.sock {{(pid=86932) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 11 17:54:11 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 11 17:54:11 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 11 17:54:11 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 11 17:54:11 devstack cinder-volume[86932]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87932 Jul 11 17:54:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f7d372-bb1f-412b-92e4-e8687330c93c]: (2,) {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:54:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf54de-71d4-48d1-95fb-72b9e00cc06d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:54:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:11 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 Jul 11 17:54:11 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:12 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819" returned: 0 in 1.310s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:12 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819 Jul 11 17:54:12 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:13 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-164e4872-adbe-46c3-9e4e-511a20230819" returned: 0 in 0.954s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "cinder-quobyte-164e4872-adbe-46c3-9e4e-511a20230819" released by "delete_volume" :: held 5.075s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:54:13 devstack cinder-volume[86932]: WARNING cinder.quota [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:54:13 devstack cinder-volume[86932]: WARNING cinder.quota [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:54:13 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Created reservations ['b4d4cd04-ef1a-4baa-af31-5bd29702df58', '6863af90-54ae-4e29-b5cc-db835c19ff1e', '84486f6b-5da1-469a-b95a-eb921abd6799', 'ada86eb4-a667-4d19-bbef-7cf0191587b9'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:14 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:54:14 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:15 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.459s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:15 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:54:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Deleted volume successfully. Jul 11 17:54:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ae5fc998-eefe-4215-adcc-10ff4987e180 tempest-VolumesAdminNegativeTest-1044910382 None] Lock "cinder-164e4872-adbe-46c3-9e4e-511a20230819-delete_volume" released by "delete_volume" :: held 7.107s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:54:24 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:54:25 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (b96ea930-d757-4db9-8a76-41a1810c3336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964528f6-1f85-41f5-9424-1dadc6a3c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964528f6-1f85-41f5-9424-1dadc6a3c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1560293575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f3b49-c108-4b08-99b5-75739b2830c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:31Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4f8eba-598a-4a68-959d-570eeac8e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4f8eba-598a-4a68-959d-570eeac8e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2867084-4125-4d4b-9d0e-7e854a8e7e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2867084-4125-4d4b-9d0e-7e854a8e7e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627f3b49-c108-4b08-99b5-75739b2830c0', 'volume_name': 'volume-627f3b49-c108-4b08-99b5-75739b2830c0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f88e3d-90ea-4ea4-876a-dea32f8ece9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f88e3d-90ea-4ea4-876a-dea32f8ece9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9b8a2e-249a-43a5-926a-1d542f89f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Volume 627f3b49-c108-4b08-99b5-75739b2830c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627f3b49-c108-4b08-99b5-75739b2830c0', 'volume_size': 1} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1560293575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f3b49-c108-4b08-99b5-75739b2830c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:31Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Creating volume 627f3b49-c108-4b08-99b5-75739b2830c0 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:54:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:54:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:30 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 1073741824 Jul 11 17:54:30 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:32 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 1073741824" returned: 0 in 1.522s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:32 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 Jul 11 17:54:32 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:33 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0" returned: 0 in 1.214s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] <== create_volume: return (2788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.790s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9b8a2e-249a-43a5-926a-1d542f89f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627f3b49-c108-4b08-99b5-75739b2830c0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb2c49-31d7-4348-b87b-e5ec72690f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Volume volume-627f3b49-c108-4b08-99b5-75739b2830c0 (627f3b49-c108-4b08-99b5-75739b2830c0): created successfully Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb2c49-31d7-4348-b87b-e5ec72690f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (b96ea930-d757-4db9-8a76-41a1810c3336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:54:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5dbc4870-0652-4944-bb99-d5138533fe4e tempest-AttachVolumeTestJSON-1296521946 None] Created volume successfully. Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:34 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:54:34 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:34 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.875s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:54:40 devstack cinder-volume[86932]: WARNING py.warnings [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 11 17:54:40 devstack cinder-volume[86932]: .first() Jul 11 17:54:40 devstack cinder-volume[86932]: Jul 11 17:54:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8972178-da5d-4900-bb36-f17ab1feb4d1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:54:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:40 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 Jul 11 17:54:40 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:41 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0" returned: 0 in 0.983s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-627f3b49-c108-4b08-99b5-75739b2830c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ae378d5-f72b-4626-a887-1a0388d37eac', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:54:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-369bc792-39d3-4e30-909c-eb34106a9527 req-4de14549-1548-45e2-88d1-a65d153b31d3 tempest-AttachVolumeTestJSON-1296521946 None] attachment_update completed successfully. Jul 11 17:54:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a2d2a-1cc8-490e-9376-10c1b0691ee0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:54:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:45 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 Jul 11 17:54:45 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:54:46 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Jul 11 17:54:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" returned: 0 in 0.853s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:54:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '704e8141-e3ea-4803-aa6a-b7bf69adb469', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:54:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-852c6fb5-d0e5-4aff-b909-6f3c3c421d16 req-03b29b78-0a3c-4da1-b0cf-a47be3dd2cfc tempest-TaggedAttachmentsTest-1618919230 None] attachment_update completed successfully. Jul 11 17:54:52 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1045a4f6-c078-44f6-9c60-9e917e8f3a8b req-e4e80510-fa5f-49a4-9507-8f85a685c735 tempest-TaggedAttachmentsTest-1618919230 None] Terminate volume connection completed successfully. Jul 11 17:54:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-1045a4f6-c078-44f6-9c60-9e917e8f3a8b req-e4e80510-fa5f-49a4-9507-8f85a685c735 tempest-TaggedAttachmentsTest-1618919230 None] Deleting attachment 704e8141-e3ea-4803-aa6a-b7bf69adb469. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Flow 'volume_create_manager' (e84aa5de-c667-4ce9-b568-9d7c065d796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaa31d4-7d17-4bae-9aef-78222636e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaa31d4-7d17-4bae-9aef-78222636e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1921891472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5eda33f-098e-4f3b-8f16-2c61c3ff294b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce903ba5a221427f943ea3e49f39bc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:59Z,use_quota=True,user_id='38a67871ce2b416eb9aebc59143fe6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dafe76-1440-4599-a372-dd4da272b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dafe76-1440-4599-a372-dd4da272b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec5b246-4e19-4fdf-a86e-9323e2758731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec5b246-4e19-4fdf-a86e-9323e2758731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'volume_name': 'volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952bf13-d3e4-4e6b-9c80-2160d88ce5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952bf13-d3e4-4e6b-9c80-2160d88ce5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c20aad-44a6-4586-9ba3-d52c8f3bb2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:54:58 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Volume e5eda33f-098e-4f3b-8f16-2c61c3ff294b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'volume_size': 1} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1921891472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5eda33f-098e-4f3b-8f16-2c61c3ff294b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce903ba5a221427f943ea3e49f39bc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:54:59Z,use_quota=True,user_id='38a67871ce2b416eb9aebc59143fe6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Creating volume e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:54:58 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:54:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:54:58 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b 1073741824 Jul 11 17:54:58 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:00 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b 1073741824" returned: 0 in 1.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:00 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b Jul 11 17:55:00 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:01 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" returned: 0 in 1.137s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] <== create_volume: return (2992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.995s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c20aad-44a6-4586-9ba3-d52c8f3bb2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a1376b-54fc-42aa-8fa7-a24dcd258760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Volume volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b (e5eda33f-098e-4f3b-8f16-2c61c3ff294b): created successfully Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a1376b-54fc-42aa-8fa7-a24dcd258760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Flow 'volume_create_manager' (e84aa5de-c667-4ce9-b568-9d7c065d796e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e738759d-36d8-4ebe-b5ca-34b958c7bee8 tempest-ServerActionsTestOtherA-197597229 None] Created volume successfully. Jul 11 17:55:11 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:55:11 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:DELETE=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Flow 'volume_create_manager' (9ea7c168-3017-4348-8e24-04f05fda9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0210bac6-f3de-49cc-86cc-1217502e3ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0210bac6-f3de-49cc-86cc-1217502e3ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1130615701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e076ea-f7ca-4dee-b4f3-4af7e9c0c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846f89ed23943bcb124946ef31ceeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:12Z,use_quota=True,user_id='4b8a27a64bb44bc0b0697d8aed970c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf0a086-1ea1-49d1-b079-ecf86df53ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf0a086-1ea1-49d1-b079-ecf86df53ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466944e-7713-4ba2-8309-722635af340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466944e-7713-4ba2-8309-722635af340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e076ea-f7ca-4dee-b4f3-4af7e9c0c828', 'volume_name': 'volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe37645-1f2b-4e41-a236-1bb9f85852b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe37645-1f2b-4e41-a236-1bb9f85852b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8cb937-21c4-442e-84f1-39b5115a2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Volume 38e076ea-f7ca-4dee-b4f3-4af7e9c0c828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828', 'volume_size': 1} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1130615701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e076ea-f7ca-4dee-b4f3-4af7e9c0c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846f89ed23943bcb124946ef31ceeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:12Z,use_quota=True,user_id='4b8a27a64bb44bc0b0697d8aed970c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Creating volume 38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:55:12 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:55:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:12 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 1073741824 Jul 11 17:55:12 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:13 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 1073741824" returned: 0 in 1.141s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:13 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 Jul 11 17:55:13 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:14 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" returned: 0 in 0.947s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8cb937-21c4-442e-84f1-39b5115a2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171d8f7e-b6a3-468f-8c66-cc1db338b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Volume volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 (38e076ea-f7ca-4dee-b4f3-4af7e9c0c828): created successfully Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171d8f7e-b6a3-468f-8c66-cc1db338b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Flow 'volume_create_manager' (9ea7c168-3017-4348-8e24-04f05fda9d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9e2f414f-97a9-4d9c-84d7-00ba70eeeab4 tempest-DeleteServersTestJSON-1974470574 None] Created volume successfully. Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "cinder-3dcf8ec5-7349-4f49-84a9-0236b9f269b3-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "cinder-3dcf8ec5-7349-4f49-84a9-0236b9f269b3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "cinder-quobyte-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "cinder-quobyte-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6474b4b9-a128-4d70-865a-0682bf674a11]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:17 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 Jul 11 17:55:17 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:17 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" returned: 0 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:17 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3 Jul 11 17:55:17 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[73edd3bf-59b9-4bf7-b5c6-0e144c69acfd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:18 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" returned: 0 in 0.933s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "cinder-quobyte-3dcf8ec5-7349-4f49-84a9-0236b9f269b3" released by "delete_volume" :: held 1.787s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Created reservations ['7a0dad58-c405-43c2-a7fc-2e8aa73dba0c', '562d05f5-e029-47be-9e36-5dc9821d1f78', '04c32bae-4d08-478a-8c77-6433b890cc1d', 'b73e91aa-18c3-4db9-9f32-b6ba7f31df07'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:18 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 Jul 11 17:55:18 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:18 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:18 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:19 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.178s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Deleted volume successfully. Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-44345fe7-3e2b-4820-9d48-250b7e16e58b tempest-TaggedAttachmentsTest-1618919230 None] Lock "cinder-3dcf8ec5-7349-4f49-84a9-0236b9f269b3-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:20 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" returned: 0 in 1.598s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.617s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53bea636-f5a7-4627-b91b-215a306385a7', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:55:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-faecb3f4-6f20-456e-97ce-71b456965512 req-403241ce-7874-4179-b037-9775c7842046 tempest-DeleteServersTestJSON-1974470574 None] attachment_update completed successfully. Jul 11 17:55:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-a83914a1-3c20-4da0-8111-14c9c529b8a3 req-78d26933-9aa3-46be-a179-b53e30b6e99b tempest-AttachVolumeTestJSON-1296521946 None] Terminate volume connection completed successfully. Jul 11 17:55:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-a83914a1-3c20-4da0-8111-14c9c529b8a3 req-78d26933-9aa3-46be-a179-b53e30b6e99b tempest-AttachVolumeTestJSON-1296521946 None] Deleting attachment 3ae378d5-f72b-4626-a887-1a0388d37eac. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:55:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-c9cac5fb-f1f6-433e-9550-87ca56e7d720 req-be11b155-3589-470e-806b-b263ab350118 tempest-DeleteServersTestJSON-1974470574 None] Terminate volume connection completed successfully. Jul 11 17:55:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-c9cac5fb-f1f6-433e-9550-87ca56e7d720 req-be11b155-3589-470e-806b-b263ab350118 tempest-DeleteServersTestJSON-1974470574 None] Deleting attachment 53bea636-f5a7-4627-b91b-215a306385a7. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "cinder-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "cinder-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "cinder-quobyte-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "cinder-quobyte-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d0f41-f198-43f8-a42d-2086e6786f20]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:33 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 Jul 11 17:55:33 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:34 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:34 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:34 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:34 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828 Jul 11 17:55:34 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:34 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.725s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 8 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:55:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (f7f4dbda-1add-48d5-82e3-43ab435c742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c32b068-2333-4d80-ace6-9781a67bc45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c32b068-2333-4d80-ace6-9781a67bc45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637034026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:35Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b2769-f1a4-4aef-9c00-42bc4f4e1ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b2769-f1a4-4aef-9c00-42bc4f4e1ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0110d4-64b3-4588-a999-9336e4966f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0110d4-64b3-4588-a999-9336e4966f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9', 'volume_name': 'volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d9076-48e8-4c5b-9cd3-655b87605ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d9076-48e8-4c5b-9cd3-655b87605ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5871d4b6-1b71-496a-9afb-d4c5b3f25e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Volume 9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9', 'volume_size': 1} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637034026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:35Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Creating volume 9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:55:35 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:35 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 1073741824 Jul 11 17:55:35 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:35 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "cinder-quobyte-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828" released by "delete_volume" :: held 1.567s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Created reservations ['930ad2be-8864-4dc4-81df-689d2095e355', '07b54ba5-00d2-4dc1-9001-7f866cf11149', 'df17122c-0629-43fb-aa72-84f92fb6b02a', 'a270b3d9-9bd7-463a-a037-8d52c4a5cd77'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:35 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:35 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:36 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:36 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Deleted volume successfully. Jul 11 17:55:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03cdd4cf-faca-4bc8-b292-bf9ff67d84a7 tempest-DeleteServersTestJSON-1974470574 None] Lock "cinder-38e076ea-f7ca-4dee-b4f3-4af7e9c0c828-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:36 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 1073741824" returned: 0 in 1.108s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:36 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 Jul 11 17:55:36 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:37 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5871d4b6-1b71-496a-9afb-d4c5b3f25e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f117b-5b87-41bf-9b21-6bb328d6f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Volume volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 (9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9): created successfully Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f117b-5b87-41bf-9b21-6bb328d6f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (f7f4dbda-1add-48d5-82e3-43ab435c742b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-dbb3f79a-e370-47cf-a930-d2eccf178cb6 tempest-VolumesTestJSON-911506033 None] Created volume successfully. Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (b6cdb271-c5af-4686-a17a-257f7c61421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c5b468-0275-46a0-a46a-1abb2fdb7574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c5b468-0275-46a0-a46a-1abb2fdb7574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468914310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600bb5cf-af25-4d38-821d-68472a835ad3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:38Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38e27ca-1f26-4296-a2ad-0babfc7cedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38e27ca-1f26-4296-a2ad-0babfc7cedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26116e57-8e18-4cc6-997b-550869842ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26116e57-8e18-4cc6-997b-550869842ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600bb5cf-af25-4d38-821d-68472a835ad3', 'volume_name': 'volume-600bb5cf-af25-4d38-821d-68472a835ad3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62592d7-97f0-498d-9b20-3c1c43f42683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62592d7-97f0-498d-9b20-3c1c43f42683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fca1226-c275-4666-be40-ed44afe49da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:38 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Volume 600bb5cf-af25-4d38-821d-68472a835ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600bb5cf-af25-4d38-821d-68472a835ad3', 'volume_size': 1} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468914310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600bb5cf-af25-4d38-821d-68472a835ad3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:38Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Creating volume 600bb5cf-af25-4d38-821d-68472a835ad3 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:55:38 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:55:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:38 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 1073741824 Jul 11 17:55:38 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:39 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 1073741824" returned: 0 in 1.254s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:39 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 Jul 11 17:55:39 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:40 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3" returned: 0 in 0.939s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fca1226-c275-4666-be40-ed44afe49da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600bb5cf-af25-4d38-821d-68472a835ad3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b31a23-2668-42f6-8b22-fd808e1f9d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:40 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Volume volume-600bb5cf-af25-4d38-821d-68472a835ad3 (600bb5cf-af25-4d38-821d-68472a835ad3): created successfully Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b31a23-2668-42f6-8b22-fd808e1f9d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (b6cdb271-c5af-4686-a17a-257f7c61421d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2f77a734-ca42-4d56-aaeb-748b95af9252 tempest-VolumesTestJSON-911506033 None] Created volume successfully. Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (d4fd768b-5e2d-4f50-9e21-a62d64796eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60973c-816e-47c9-a41f-e898c573a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60973c-816e-47c9-a41f-e898c573a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-137956783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7765f85-cf5f-492f-9a36-e5f54e2d36c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:42Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea5b444-3499-4048-8baf-ccd14492de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea5b444-3499-4048-8baf-ccd14492de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787ea0ab-bb12-4eca-a56a-047d7190a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787ea0ab-bb12-4eca-a56a-047d7190a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7765f85-cf5f-492f-9a36-e5f54e2d36c3', 'volume_name': 'volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80a320-f31d-4327-8015-2fff72cf986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80a320-f31d-4327-8015-2fff72cf986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b7186c-6bcc-4119-8cf5-24596bb6bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:42 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Volume d7765f85-cf5f-492f-9a36-e5f54e2d36c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3', 'volume_size': 1} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-137956783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7765f85-cf5f-492f-9a36-e5f54e2d36c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7f280944b74106a4caadbb441ff848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:42Z,use_quota=True,user_id='1a5bd93c6a61416dbd004da562ccb25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Creating volume d7765f85-cf5f-492f-9a36-e5f54e2d36c3 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:55:42 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:55:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:42 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 1073741824 Jul 11 17:55:42 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:43 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 1073741824" returned: 0 in 1.113s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:43 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 Jul 11 17:55:43 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:44 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" returned: 0 in 0.918s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b7186c-6bcc-4119-8cf5-24596bb6bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9e25d8-b292-4b0d-b057-cc7f57be05d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:44 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Volume volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 (d7765f85-cf5f-492f-9a36-e5f54e2d36c3): created successfully Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9e25d8-b292-4b0d-b057-cc7f57be05d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Flow 'volume_create_manager' (d4fd768b-5e2d-4f50-9e21-a62d64796eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-92242850-5e42-441c-9410-ca86b5652b0c tempest-VolumesTestJSON-911506033 None] Created volume successfully. Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Flow 'volume_create_manager' (507cbc4c-b4be-4e36-98a0-1c21fc18c274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbdea26-3623-4703-a1ec-ab7ced3f7bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbdea26-3623-4703-a1ec-ab7ced3f7bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-289541164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5558e8-940e-46cd-9550-317fcabd42db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f680a9bfde524b5894ce744e5cc68261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:46Z,use_quota=True,user_id='97e9e11c76b540d4948263e6229ac959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7212f0-b91c-40cc-868d-8a29ac15caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7212f0-b91c-40cc-868d-8a29ac15caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83e42ec-ff40-4925-821a-755a1e13ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83e42ec-ff40-4925-821a-755a1e13ccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5558e8-940e-46cd-9550-317fcabd42db', 'volume_name': 'volume-6f5558e8-940e-46cd-9550-317fcabd42db', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777bf17a-b24b-4b87-b9b1-5601d98711ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777bf17a-b24b-4b87-b9b1-5601d98711ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d5a953-1ebf-4018-aa6d-2932deb9142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:45 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Volume 6f5558e8-940e-46cd-9550-317fcabd42db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5558e8-940e-46cd-9550-317fcabd42db', 'volume_size': 1} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-289541164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5558e8-940e-46cd-9550-317fcabd42db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f680a9bfde524b5894ce744e5cc68261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:55:46Z,use_quota=True,user_id='97e9e11c76b540d4948263e6229ac959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Creating volume 6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:55:45 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:55:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:45 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db 1073741824 Jul 11 17:55:45 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-d7765f85-cf5f-492f-9a36-e5f54e2d36c3-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "cinder-d7765f85-cf5f-492f-9a36-e5f54e2d36c3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:47 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db 1073741824" returned: 0 in 1.141s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-quobyte-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[04399307-df34-4882-a87c-705c9b5cf90a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:47 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db Jul 11 17:55:47 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:47 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 Jul 11 17:55:47 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:47 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.484s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d5a953-1ebf-4018-aa6d-2932deb9142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5558e8-940e-46cd-9550-317fcabd42db', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05d93de-becc-4edb-9e75-c2edb56533f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0e84f-40e5-4d58-bdfb-7edc3b048674]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:47 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Volume volume-6f5558e8-940e-46cd-9550-317fcabd42db (6f5558e8-940e-46cd-9550-317fcabd42db): created successfully Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05d93de-becc-4edb-9e75-c2edb56533f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:55:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Flow 'volume_create_manager' (507cbc4c-b4be-4e36-98a0-1c21fc18c274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:55:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-0f0e1cfd-ff2b-427d-8d27-229e145cb148 req-afb57578-5257-4ef2-aa49-87bc5c9a08c3 tempest-VolumesSnapshotsTestJSON-1137366027 None] Created volume successfully. Jul 11 17:55:48 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" returned: 0 in 0.840s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:48 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3 Jul 11 17:55:48 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:48 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b Jul 11 17:55:48 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:48 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" returned: 0 in 0.978s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.244s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Creating offline snapshot 4e7375ae-3c17-4b12-b2ba-b436224df7bd of volume 6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfb4388-3185-435e-baf7-7fc566122c85]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9d468c2-df70-49bd-8e18-059b3cd7d809', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:55:49 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" returned: 0 in 1.005s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-d7765f85-cf5f-492f-9a36-e5f54e2d36c3" released by "delete_volume" :: held 1.919s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-3861d7bf-3eb2-4489-8cac-9e9b96040bec req-f0b35ce9-fc3d-4fbb-a504-78af779530ac tempest-ServerActionsTestOtherA-197597229 None] attachment_update completed successfully. Jul 11 17:55:49 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db Jul 11 17:55:49 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Created reservations ['8227afaa-8f4f-498f-aced-e31bd8811de2', '301af516-9cab-4b1d-8ad8-c90f38d7ff80', '403720a0-8764-4ce8-8810-d4c5be645a2d', '5d065906-23e8-4c07-a371-f4233fb88e01'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:49 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:49 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:49 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db" returned: 0 in 0.922s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:49 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd 1G Jul 11 17:55:49 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:49 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.742s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:49 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Deleted volume successfully. Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c937b230-0376-4a69-a6e7-ed0c3f5c7288 tempest-VolumesTestJSON-911506033 None] Lock "cinder-d7765f85-cf5f-492f-9a36-e5f54e2d36c3-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-600bb5cf-af25-4d38-821d-68472a835ad3-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "cinder-600bb5cf-af25-4d38-821d-68472a835ad3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-quobyte-600bb5cf-af25-4d38-821d-68472a835ad3" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-600bb5cf-af25-4d38-821d-68472a835ad3" acquired by "delete_volume" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bbe864-b49c-4ede-9641-640306ef38f9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:50 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 Jul 11 17:55:50 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:50 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd 1G" returned: 0 in 0.892s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5558e8-940e-46cd-9550-317fcabd42db -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:50 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5558e8-940e-46cd-9550-317fcabd42db -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd Jul 11 17:55:50 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:51 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:51 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3 Jul 11 17:55:51 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:51 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5558e8-940e-46cd-9550-317fcabd42db -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:51 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd is being set with open permissions: ugo+rw Jul 11 17:55:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:51 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd Jul 11 17:55:51 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:52 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-600bb5cf-af25-4d38-821d-68472a835ad3" returned: 0 in 0.703s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-600bb5cf-af25-4d38-821d-68472a835ad3" released by "delete_volume" :: held 1.606s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Created reservations ['2c698957-b3fb-45c5-9fe9-d62d0da0e668', '179c651f-31a9-4963-9851-2a648a423ef2', 'bab58173-6cfa-46ca-b670-5c2db23c8333', '95ec67ad-6273-4a7f-9f5a-0b6ba2f3b32e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:52 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:52 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:52 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd" returned: 0 in 0.719s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:52 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info Jul 11 17:55:52 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "cinder-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Acquiring lock "cinder-quobyte-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedd1a5-2bc1-4344-b348-e26476f39472]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:52 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 Jul 11 17:55:52 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:53 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.807s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Deleted volume successfully. Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-90b63bd6-d943-4e77-b66d-385770e4b433 tempest-VolumesTestJSON-911506033 None] Lock "cinder-600bb5cf-af25-4d38-821d-68472a835ad3-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:53 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info" returned: 0 in 0.886s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:53 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info is being set with open permissions: ugo+rw Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:53 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info Jul 11 17:55:53 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:53 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" returned: 0 in 0.925s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:53 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9 Jul 11 17:55:53 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:53 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.info" returned: 0 in 0.691s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.993s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1f6fda3e-e71a-44dc-bef1-fe1a10773304 req-303d8119-7ea8-4ff1-a71b-8577fcb44c0a tempest-VolumesSnapshotsTestJSON-1137366027 None] Create snapshot completed successfully Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "cinder-4e7375ae-3c17-4b12-b2ba-b436224df7bd-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-4e7375ae-3c17-4b12-b2ba-b436224df7bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "cinder-quobyte-4e7375ae-3c17-4b12-b2ba-b436224df7bd" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-4e7375ae-3c17-4b12-b2ba-b436224df7bd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Deleting offline snapshot 4e7375ae-3c17-4b12-b2ba-b436224df7bd of volume 6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] snapshot_file for this snap is: volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d99f526-be59-4260-b9cb-795c0650e8e1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:54 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" returned: 0 in 0.735s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "cinder-quobyte-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9" released by "delete_volume" :: held 1.712s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:54 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd Jul 11 17:55:54 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Created reservations ['c815bb9d-a757-42ae-97aa-f6b9b73666b3', '87ec9262-120f-4f75-bfe8-860f3da87669', 'a82ff217-046e-46f5-9e3d-f4733cde0599', 'b302ecdb-0894-451e-b124-f1315aec45d3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:55:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:54 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:55:54 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:55 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5558e8-940e-46cd-9550-317fcabd42db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a6023-c50f-414d-88d7-91c1266bb96d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:55 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.695s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:55:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Deleted volume successfully. Jul 11 17:55:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-55694c0d-2ed6-4964-80a0-a882c3a75825 tempest-VolumesTestJSON-911506033 None] Lock "cinder-9fe5a7f6-c06c-4ce2-8bf6-f81d9c3e56b9-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:55 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db Jul 11 17:55:55 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:56 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db" returned: 0 in 0.796s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:56 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd Jul 11 17:55:56 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-9bd6065d-d857-4e4a-99d4-502920a2fd25 tempest-ServerActionsTestOtherA-197597229 None] Terminate volume connection completed successfully. Jul 11 17:55:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-9bd6065d-d857-4e4a-99d4-502920a2fd25 tempest-ServerActionsTestOtherA-197597229 None] Deleting attachment d9d468c2-df70-49bd-8e18-059b3cd7d809. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:55:56 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:56 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd Jul 11 17:55:56 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:57 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db.4e7375ae-3c17-4b12-b2ba-b436224df7bd" returned: 0 in 0.683s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-4e7375ae-3c17-4b12-b2ba-b436224df7bd" released by "_delete_snapshot" :: held 3.272s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" released by "delete_snapshot" :: held 3.305s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:57 devstack cinder-volume[86932]: WARNING cinder.quota [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:55:57 devstack cinder-volume[86932]: DEBUG cinder.quota [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Created reservations ['032aac8c-10ab-453f-ad6d-d046a7dcdd35', '4e845d21-c7a8-4ac7-8e78-00387578eb18', '73b54f49-9141-42de-a661-52aca44ad701', '0c7acd86-aef5-45f7-8fce-500e6b3d0e80'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:55:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Delete snapshot completed successfully. Jul 11 17:55:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-dea72117-e458-4d35-8bd6-7a214c8fc5a5 req-87d104f1-41cd-4dc0-8d0f-8c8d98ce5ed4 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-4e7375ae-3c17-4b12-b2ba-b436224df7bd-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "cinder-6f5558e8-940e-46cd-9550-317fcabd42db-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-6f5558e8-940e-46cd-9550-317fcabd42db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc488b-7275-44d5-b832-2891a5fd4616]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:59 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db Jul 11 17:55:59 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48737e-d0c1-4fd4-9a4b-adfd8b057b8d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:59 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b Jul 11 17:55:59 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:55:59 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db" returned: 0 in 0.809s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:55:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:55:59 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db Jul 11 17:55:59 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:00 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" returned: 0 in 0.880s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2066d0d-079a-4a27-b1db-10f24d923836', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:56:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1341dcee-9eb8-4a7f-a388-0f8485dc31d9 req-a05c5d13-ce34-4181-af82-51b1bd94430e tempest-ServerActionsTestOtherA-197597229 None] attachment_update completed successfully. Jul 11 17:56:00 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f5558e8-940e-46cd-9550-317fcabd42db" returned: 0 in 0.755s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-quobyte-6f5558e8-940e-46cd-9550-317fcabd42db" released by "delete_volume" :: held 1.631s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG cinder.quota [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Created reservations ['571535bc-d38f-4d3c-926e-843190c81465', 'afcb0a0f-2f4b-4e86-a132-a39d088c0826', '7c58e1d4-d0fc-4064-a522-49acdbdf1ad3', '7ee0c432-a52f-4e86-93e3-37ed2f654f37'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:00 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:00 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:01 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.728s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:01 devstack cinder-volume[86932]: DEBUG cinder.manager [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Deleted volume successfully. Jul 11 17:56:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-cb4be4d2-88d9-40b6-8f77-be24f4177a8b req-b2681aaf-610a-4d1b-8f64-1b03bc50fce1 tempest-VolumesSnapshotsTestJSON-1137366027 None] Lock "cinder-6f5558e8-940e-46cd-9550-317fcabd42db-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-99602a61-4fe9-4dd3-9595-71e3bf445018 tempest-BackendsCapabilitiesAdminTestsJSON-732147256 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86932) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 17:56:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-890a3094-29c1-4024-9704-c105888fc3e1 tempest-BackendsCapabilitiesAdminTestsJSON-732147256 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86932) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Flow 'volume_create_manager' (12ff243a-d53f-4c28-beda-eb502dc1c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d38e5-8455-430b-a207-68f122b71fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d38e5-8455-430b-a207-68f122b71fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1229095865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826db036-5b01-4133-b3d4-09d01f7f6321,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a305cc6196f9414f809c4f0c7d78fe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:06Z,use_quota=True,user_id='6f9b25a77d7f44408efa8f5993c1f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4d0999-bad7-4fce-8105-e0eb55b0be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4d0999-bad7-4fce-8105-e0eb55b0be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459a6cd-6336-42b7-9899-68f75c17c492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459a6cd-6336-42b7-9899-68f75c17c492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826db036-5b01-4133-b3d4-09d01f7f6321', 'volume_name': 'volume-826db036-5b01-4133-b3d4-09d01f7f6321', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc662973-9b7f-41bd-9013-e1c8c05be2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc662973-9b7f-41bd-9013-e1c8c05be2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae179736-e9bc-4cea-a66a-351605e344bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:06 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Volume 826db036-5b01-4133-b3d4-09d01f7f6321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826db036-5b01-4133-b3d4-09d01f7f6321', 'volume_size': 1} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1229095865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826db036-5b01-4133-b3d4-09d01f7f6321,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a305cc6196f9414f809c4f0c7d78fe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:06Z,use_quota=True,user_id='6f9b25a77d7f44408efa8f5993c1f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Creating volume 826db036-5b01-4133-b3d4-09d01f7f6321 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:56:06 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:56:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:06 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 1073741824 Jul 11 17:56:06 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:07 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 1073741824" returned: 0 in 1.172s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:07 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 Jul 11 17:56:07 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:08 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321" returned: 0 in 1.053s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae179736-e9bc-4cea-a66a-351605e344bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826db036-5b01-4133-b3d4-09d01f7f6321', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe04f20b-44d3-4785-b923-34d7ccfa1715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Volume volume-826db036-5b01-4133-b3d4-09d01f7f6321 (826db036-5b01-4133-b3d4-09d01f7f6321): created successfully Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe04f20b-44d3-4785-b923-34d7ccfa1715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Flow 'volume_create_manager' (12ff243a-d53f-4c28-beda-eb502dc1c32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-9dcbac79-86af-4ff9-bb81-93fab080fbd1 req-6a6b9749-1158-460a-b6ee-dcde45844f54 tempest-VolumesGetTestJSON-958757287 None] Created volume successfully. Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Acquiring lock "cinder-826db036-5b01-4133-b3d4-09d01f7f6321-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "cinder-826db036-5b01-4133-b3d4-09d01f7f6321-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Acquiring lock "cinder-quobyte-826db036-5b01-4133-b3d4-09d01f7f6321" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "cinder-quobyte-826db036-5b01-4133-b3d4-09d01f7f6321" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dc93a-0cb5-4c0e-90be-7d753ba28bf7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:09 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 Jul 11 17:56:09 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:10 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321" returned: 0 in 0.951s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:10 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321 Jul 11 17:56:10 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:11 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-826db036-5b01-4133-b3d4-09d01f7f6321" returned: 0 in 0.860s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "cinder-quobyte-826db036-5b01-4133-b3d4-09d01f7f6321" released by "delete_volume" :: held 1.872s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG cinder.quota [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Created reservations ['f37e8569-abe9-44b5-9a90-2a4df7c5d1f1', 'f2ed7889-dac9-4232-89bd-9760705338f8', 'ffb12f16-d46b-49f6-b0f7-b33c59b0a1f3', '0066a4a3-0c61-43ab-8cef-75ea54ad396e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:11 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:11 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6783106b-f014-458d-9d23-e0f878bfbe2f tempest-GroupsV320Test-13889243 None] Group tempest-GroupsV320Test-Group-498761081: creating Jul 11 17:56:12 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=84,cinder:UPDATE=83,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:56:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6783106b-f014-458d-9d23-e0f878bfbe2f tempest-GroupsV320Test-13889243 None] Group tempest-GroupsV320Test-Group-498761081: created successfully Jul 11 17:56:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6783106b-f014-458d-9d23-e0f878bfbe2f tempest-GroupsV320Test-13889243 None] Create group completed successfully. Jul 11 17:56:12 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.889s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:12 devstack cinder-volume[86932]: DEBUG cinder.manager [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Deleted volume successfully. Jul 11 17:56:12 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=70,cinder:INSERT=18,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:56:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-d5c4ca40-1020-4a3a-9e2c-ee0e7d6c58da req-9a19ca85-81b9-43af-8e84-8493149318e7 tempest-VolumesGetTestJSON-958757287 None] Lock "cinder-826db036-5b01-4133-b3d4-09d01f7f6321-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Created reservations ['4afd2b5a-22da-49d8-a95e-844487a1133b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:14 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:14 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:15 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.771s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:15 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9062f7db-d009-4f6f-9756-c0cf409df96a tempest-GroupsV320Test-13889243 None] Delete group completed successfully. Jul 11 17:56:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-70fa21f2-440a-47f2-b445-b5c88f022554 tempest-GroupsV314Test-1712680825 None] Group tempest-GroupsV314Test-Group-2105172337: creating Jul 11 17:56:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-70fa21f2-440a-47f2-b445-b5c88f022554 tempest-GroupsV314Test-1712680825 None] Group tempest-GroupsV314Test-Group-2105172337: created successfully Jul 11 17:56:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-70fa21f2-440a-47f2-b445-b5c88f022554 tempest-GroupsV314Test-1712680825 None] Create group completed successfully. Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Flow 'volume_create_manager' (291fcee8-2bee-492b-b800-a247ebd4af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf995bf-88a2-4116-83ca-6b26e0c0cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf995bf-88a2-4116-83ca-6b26e0c0cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895944338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e90bd74-ab1b-44b1-90da-a6e18bd965d8,host='devstack@QuobyteHD#QuobyteHD',id=a0dad20b-0a7d-409c-ada3-f929f547373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c24d29f74a24143a642144b9b7fb4e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:20Z,use_quota=True,user_id='65f759975d3e42b0821e6044a90e76d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cccc12-7949-4555-a2b1-248cdad83a29),volume_type_id=13cccc12-7949-4555-a2b1-248cdad83a29)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab7897-79ac-45cb-83c2-1fbdaa3ac203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab7897-79ac-45cb-83c2-1fbdaa3ac203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ff2ae-302a-4950-bd3a-881c682c9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ff2ae-302a-4950-bd3a-881c682c9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dad20b-0a7d-409c-ada3-f929f547373c', 'volume_name': 'volume-a0dad20b-0a7d-409c-ada3-f929f547373c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f219a511-3979-4290-bd79-a2a7cdf1c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f219a511-3979-4290-bd79-a2a7cdf1c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb03ffdd-9571-4396-a30a-91458af51d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Volume a0dad20b-0a7d-409c-ada3-f929f547373c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dad20b-0a7d-409c-ada3-f929f547373c', 'volume_size': 1} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e90bd74-ab1b-44b1-90da-a6e18bd965d8,created_at=2026-07-11T15:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895944338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e90bd74-ab1b-44b1-90da-a6e18bd965d8,host='devstack@QuobyteHD#QuobyteHD',id=a0dad20b-0a7d-409c-ada3-f929f547373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c24d29f74a24143a642144b9b7fb4e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:20Z,use_quota=True,user_id='65f759975d3e42b0821e6044a90e76d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cccc12-7949-4555-a2b1-248cdad83a29),volume_type_id=13cccc12-7949-4555-a2b1-248cdad83a29)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Creating volume a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:56:19 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:56:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:19 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c 1073741824 Jul 11 17:56:19 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:20 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c 1073741824" returned: 0 in 1.058s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:20 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:20 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:21 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 0.702s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb03ffdd-9571-4396-a30a-91458af51d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dad20b-0a7d-409c-ada3-f929f547373c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238a58bd-4e3c-420d-bdca-3e6f3c8aea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:21 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Volume volume-a0dad20b-0a7d-409c-ada3-f929f547373c (a0dad20b-0a7d-409c-ada3-f929f547373c): created successfully Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238a58bd-4e3c-420d-bdca-3e6f3c8aea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Flow 'volume_create_manager' (291fcee8-2bee-492b-b800-a247ebd4af08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-69238bf9-420a-4814-b2aa-8293c92b2280 tempest-GroupsV314Test-1712680825 None] Created volume successfully. Jul 11 17:56:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Cloning volume a0dad20b-0a7d-409c-ada3-f929f547373c to volume fc1a6ac0-aaf6-4209-8a24-941d36c39b3d Jul 11 17:56:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Creating offline snapshot 13604a61-865a-46af-8976-996d6737ca78 of volume a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:56:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b28e80-1122-4573-b465-76b3d614321d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:23 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:23 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:24 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 0.940s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:24 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 1G Jul 11 17:56:24 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:25 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 1G" returned: 0 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0dad20b-0a7d-409c-ada3-f929f547373c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:25 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0dad20b-0a7d-409c-ada3-f929f547373c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:25 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:25 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0dad20b-0a7d-409c-ada3-f929f547373c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.737s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:25 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 17:56:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:26 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:26 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:26 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.718s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:26 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info Jul 11 17:56:26 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:27 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info" returned: 0 in 1.157s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:27 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 17:56:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:28 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info Jul 11 17:56:28 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:28 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.info" returned: 0 in 1.030s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Acquiring lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] snapshot: 13604a61-865a-46af-8976-996d6737ca78, volume: fc1a6ac0-aaf6-4209-8a24-941d36c39b3d, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d6a03-fecb-428d-892a-9ed4d1bb9a53]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:29 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:29 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:29 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.752s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0dad20b-0a7d-409c-ada3-f929f547373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c455fe7-883b-4473-877e-a575bd762cda]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:29 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:29 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:30 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 0.872s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:30 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 17:56:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:30 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d Jul 11 17:56:30 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-7ca6041a-e330-4da6-85c7-26f0907e69b1 req-9ed889b1-a6a4-47b9-b89b-01328f89c167 tempest-ServerActionsTestOtherA-197597229 None] Terminate volume connection completed successfully. Jul 11 17:56:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-7ca6041a-e330-4da6-85c7-26f0907e69b1 req-9ed889b1-a6a4-47b9-b89b-01328f89c167 tempest-ServerActionsTestOtherA-197597229 None] Deleting attachment a2066d0d-079a-4a27-b1db-10f24d923836. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:34 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:34 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:35 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.754s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:56:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 8 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:56:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:56:41 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" returned: 0 in 10.308s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[73457cba-c679-4f54-b75d-c7253a95391c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:41 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:41 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:42 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 1.876s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:42 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c, size 1024.00 MB, duration 10.31 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 17:56:42 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Converted 1024.00 MB image at 99.30 MB/s Jul 11 17:56:42 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d is being set with open permissions: ugo+rw: NotImplementedError Jul 11 17:56:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:42 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d Jul 11 17:56:42 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:43 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" returned: 0 in 0.717s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" released by "_copy_volume_from_snapshot" :: held 14.645s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Acquiring lock "cinder-quobyte-13604a61-865a-46af-8976-996d6737ca78" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-13604a61-865a-46af-8976-996d6737ca78" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Deleting offline snapshot 13604a61-865a-46af-8976-996d6737ca78 of volume a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] snapshot_file for this snap is: volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a245cb9f-8e82-4637-852c-17eb0c19e460]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:43 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:56:43 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:43 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:44 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.779s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0dad20b-0a7d-409c-ada3-f929f547373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:56:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced11181-17ed-4c88-a8e2-c263a598c431]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:44 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:44 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:45 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 0.790s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:45 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:45 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Flow 'volume_create_manager' (d172a7ae-a534-435c-8d34-07e2051440ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731c76e-5ac9-4506-aebf-7acca4ab695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731c76e-5ac9-4506-aebf-7acca4ab695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1282618766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffb6f9c-b995-444d-b511-c34b4e4ac16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9e814ca7c40348b20b60c02f065b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:45Z,use_quota=True,user_id='8db021e0488d43b4a1acd8b8c67c2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9f57b5-8040-4c18-b2cf-1770062becc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9f57b5-8040-4c18-b2cf-1770062becc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df750ab-430c-4b24-9d67-743f9cba2074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df750ab-430c-4b24-9d67-743f9cba2074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffb6f9c-b995-444d-b511-c34b4e4ac16f', 'volume_name': 'volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e8d07-094d-4de9-8ac4-460ed4b5ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e8d07-094d-4de9-8ac4-460ed4b5ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5e2098-c5ba-4df6-accb-f2652004f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:45 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume 1ffb6f9c-b995-444d-b511-c34b4e4ac16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f', 'volume_size': 1} Jul 11 17:56:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:46 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:46 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78 Jul 11 17:56:46 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:46 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c.13604a61-865a-46af-8976-996d6737ca78" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-13604a61-865a-46af-8976-996d6737ca78" released by "_delete_snapshot" :: held 3.142s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "cinder-e5eda33f-098e-4f3b-8f16-2c61c3ff294b-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.522s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "cinder-e5eda33f-098e-4f3b-8f16-2c61c3ff294b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1282618766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffb6f9c-b995-444d-b511-c34b4e4ac16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9e814ca7c40348b20b60c02f065b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:45Z,use_quota=True,user_id='8db021e0488d43b4a1acd8b8c67c2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Creating volume 1ffb6f9c-b995-444d-b511-c34b4e4ac16f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:56:46 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:46 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f 1073741824 Jul 11 17:56:46 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "cinder-quobyte-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "cinder-quobyte-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4c3590bd-3040-4885-89dc-784f4afae016 tempest-GroupsV314Test-1712680825 None] Create group from source-group-1e90bd74-ab1b-44b1-90da-a6e18bd965d8 completed successfully. Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b840ac2-9932-4313-89cd-c03ae26bb923]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:47 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b Jul 11 17:56:47 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:47 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f 1073741824" returned: 0 in 0.849s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:47 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f Jul 11 17:56:47 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:47 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" returned: 0 in 0.815s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:47 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b Jul 11 17:56:47 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Acquiring lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:48 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" returned: 0 in 0.640s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:48 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "cinder-quobyte-e5eda33f-098e-4f3b-8f16-2c61c3ff294b" released by "delete_volume" :: held 1.507s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" returned: 0 in 0.736s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3320ae46-d689-435c-95e4-246ab19525d4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5e2098-c5ba-4df6-accb-f2652004f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79715e8c-cff1-4e60-b3d1-7cf3b6c4bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:48 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f (1ffb6f9c-b995-444d-b511-c34b4e4ac16f): created successfully Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79715e8c-cff1-4e60-b3d1-7cf3b6c4bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Flow 'volume_create_manager' (d172a7ae-a534-435c-8d34-07e2051440ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:48 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a6c2d437-e818-419a-98e9-dc190c36fb3d tempest-VolumeQuotasAdminTestJSON-423296627 None] Created volume successfully. Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Created reservations ['b8448243-e518-4cec-8a19-52585bb97df8', '891cbfa4-06f2-46e0-98f3-1401ac6034be', '996d3c3b-bb6e-4aca-959a-34eb1011ed8c', '3a8edb80-a860-4c15-8274-f9211a3429b5'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:48 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d Jul 11 17:56:48 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:48 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:48 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:49 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" returned: 0 in 0.924s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:49 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d Jul 11 17:56:49 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:49 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.814s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Deleted volume successfully. Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e60bb234-f307-4b3e-bc19-90bc3f611ed6 tempest-ServerActionsTestOtherA-197597229 None] Lock "cinder-e5eda33f-098e-4f3b-8f16-2c61c3ff294b-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "cinder-1ffb6f9c-b995-444d-b511-c34b4e4ac16f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "cinder-1ffb6f9c-b995-444d-b511-c34b4e4ac16f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "cinder-quobyte-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "cinder-quobyte-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3137d3c-0b21-4b8b-9896-d9619050a756]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:50 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f Jul 11 17:56:50 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:50 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" returned: 0 in 0.780s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-fc1a6ac0-aaf6-4209-8a24-941d36c39b3d" released by "delete_volume" :: held 1.759s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Created reservations ['d94802f8-a8d0-46e7-95b0-e3294b41c46a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:50 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1904563537 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1904563537, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:56:50 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1904563537 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1904563537, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Created reservations ['3c6f92f6-6079-4820-92bc-6d67d00c1e1b', '4863225f-65a1-4a41-b5a8-3af19f90259e', '4795992c-f122-4957-b0ae-f6119f13cdad', '5fe10855-fe29-46ba-9fe8-a27f8cf4ae32'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:50 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:50 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:50 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" returned: 0 in 0.889s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:50 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f Jul 11 17:56:50 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Acquiring lock "cinder-quobyte-a0dad20b-0a7d-409c-ada3-f929f547373c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-a0dad20b-0a7d-409c-ada3-f929f547373c" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b02b63-1611-4a85-9594-c6a96d9ba4fb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:51 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:51 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:51 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.173s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a6ea48c2-1042-45b0-af10-1c4cb497ea8e tempest-GroupsV314Test-1712680825 None] Delete group completed successfully. Jul 11 17:56:51 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" returned: 0 in 1.071s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "cinder-quobyte-1ffb6f9c-b995-444d-b511-c34b4e4ac16f" released by "delete_volume" :: held 2.018s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:51 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Created reservations ['31d7a2d4-bf3c-429d-8740-b4ff6368cc36', '2a63cca7-0d7f-47ca-9eb9-0a664dc53833', 'f7736e37-4a4e-4cb0-9fd4-48e7c758b718', 'd64a1178-75fe-46f4-9071-68e32e312147'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:52 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:52 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (372a8266-0380-47af-a3df-33648143690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3955d0-ba3c-478e-a970-43ab8dc522ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3955d0-ba3c-478e-a970-43ab8dc522ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-281825177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:52Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:52 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb676a-26ac-4c40-823f-abd3183e1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb676a-26ac-4c40-823f-abd3183e1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a072c60-e95a-49e7-a56b-b7a5c8eebde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a072c60-e95a-49e7-a56b-b7a5c8eebde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4', 'volume_name': 'volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c656a6b3-8b0b-4db9-bc61-6f9d7fb8148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c656a6b3-8b0b-4db9-bc61-6f9d7fb8148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b74006e-7331-4f80-ae6d-4da294445635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:52 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Volume a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4', 'volume_size': 1} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-281825177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:52Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Creating volume a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:56:52 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 1.203s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:52 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 1073741824 Jul 11 17:56:52 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:52 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c Jul 11 17:56:52 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:53 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.981s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Deleted volume successfully. Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f55c4f76-00cd-4748-a94e-f4cfca2ad4ef tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "cinder-1ffb6f9c-b995-444d-b511-c34b4e4ac16f-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:53 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a0dad20b-0a7d-409c-ada3-f929f547373c" returned: 0 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Lock "cinder-quobyte-a0dad20b-0a7d-409c-ada3-f929f547373c" released by "delete_volume" :: held 2.158s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Created reservations ['1bf094c7-7c97-4af4-beca-bf8073d88a11'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Created reservations ['09330159-89bb-4a3d-b239-f700e86453b3', '44a44d56-4b2e-4170-a8de-44a4a832effb', 'b5fe35ae-fb55-4396-a7f7-74cce47bf5c2', 'd76d4878-e306-46cc-94ac-fa16d77cdb96'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Flow 'volume_create_manager' (8998299e-edfe-43ea-b578-5a4f33be8c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5d8d3-d5f7-413d-aa3a-6b86f688db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5d8d3-d5f7-413d-aa3a-6b86f688db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1491763793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e17bb53-0100-4b05-a56c-0119d7f75241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9e814ca7c40348b20b60c02f065b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:54Z,use_quota=True,user_id='8db021e0488d43b4a1acd8b8c67c2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf97035-71ae-4d64-b3a0-fc697c2c2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf97035-71ae-4d64-b3a0-fc697c2c2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d9797c-0954-4052-a37c-ab1c3a8d27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d9797c-0954-4052-a37c-ab1c3a8d27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e17bb53-0100-4b05-a56c-0119d7f75241', 'volume_name': 'volume-1e17bb53-0100-4b05-a56c-0119d7f75241', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76d9267-f9e6-4422-a133-1c827ff758c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76d9267-f9e6-4422-a133-1c827ff758c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d45c28b-71df-4177-b132-d2c8b00ab7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume 1e17bb53-0100-4b05-a56c-0119d7f75241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e17bb53-0100-4b05-a56c-0119d7f75241', 'volume_size': 1} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:53 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 1073741824" returned: 0 in 1.204s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:53 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:53 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:53 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:56:53 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:54 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" returned: 0 in 0.715s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1491763793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e17bb53-0100-4b05-a56c-0119d7f75241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9e814ca7c40348b20b60c02f065b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:56:54Z,use_quota=True,user_id='8db021e0488d43b4a1acd8b8c67c2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Creating volume 1e17bb53-0100-4b05-a56c-0119d7f75241 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:56:54 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:54 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:56:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-94a06320-bd0e-4ebd-91be-7e621929b655 tempest-GroupsV314Test-1712680825 None] Delete group completed successfully. Jul 11 17:56:54 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 1073741824 Jul 11 17:56:54 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b74006e-7331-4f80-ae6d-4da294445635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59096b28-8582-4f34-a3a0-d7a90328d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:54 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Volume volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 (a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4): created successfully Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59096b28-8582-4f34-a3a0-d7a90328d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (372a8266-0380-47af-a3df-33648143690c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f15648d4-9e7f-4a7b-8729-3cd76f78aba0 tempest-AttachVolumeTestJSON-1296521946 None] Created volume successfully. Jul 11 17:56:55 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 1073741824" returned: 0 in 0.917s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:55 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 Jul 11 17:56:55 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:56 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241" returned: 0 in 0.736s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d45c28b-71df-4177-b132-d2c8b00ab7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e17bb53-0100-4b05-a56c-0119d7f75241', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482ab838-ed68-415a-9210-9df6e3990e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:56:56 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Volume volume-1e17bb53-0100-4b05-a56c-0119d7f75241 (1e17bb53-0100-4b05-a56c-0119d7f75241): created successfully Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482ab838-ed68-415a-9210-9df6e3990e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:56:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Flow 'volume_create_manager' (8998299e-edfe-43ea-b578-5a4f33be8c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:56:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f8097b19-b029-4ec2-8888-32926ac09113 tempest-VolumeQuotasAdminTestJSON-423296627 None] Created volume successfully. Jul 11 17:56:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7aea5158-8cbf-4b38-87dd-c88c6fbdcd76 tempest-VolumeQuotasAdminTestJSON-2088804489 None] Transfer volume completed successfully. Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Acquiring lock "cinder-1e17bb53-0100-4b05-a56c-0119d7f75241-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f311909-fa92-4b49-a81e-bc4aa7f548ea]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "cinder-1e17bb53-0100-4b05-a56c-0119d7f75241-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Acquiring lock "cinder-quobyte-1e17bb53-0100-4b05-a56c-0119d7f75241" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:56:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "cinder-quobyte-1e17bb53-0100-4b05-a56c-0119d7f75241" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1784c-1d4b-4813-a916-a9f868299879]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:56:59 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 Jul 11 17:56:59 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:59 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 Jul 11 17:56:59 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:56:59 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" returned: 0 in 1.014s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.068s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:56:59 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241" returned: 0 in 0.962s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:56:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:00 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241 Jul 11 17:57:00 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3308c6fe-773a-42c3-ae80-a325b347db79', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Flow 'volume_create_manager' (989bdbb2-f0e1-4358-b305-712f9a6d6408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b27c81-ff9d-491a-8003-1fa1266b2ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b27c81-ff9d-491a-8003-1fa1266b2ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-206530847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f77d6-a260-4425-95b2-e610394f707e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d708068b20444bb6cc9760454ce341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:00Z,use_quota=True,user_id='0c415041ab5845f2ae2efb51280d7c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e6a10a-bab7-40c2-8bb5-f30add139db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e6a10a-bab7-40c2-8bb5-f30add139db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612bf0a7-959b-4bf2-8d12-7b0cd3cd1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612bf0a7-959b-4bf2-8d12-7b0cd3cd1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77f77d6-a260-4425-95b2-e610394f707e', 'volume_name': 'volume-c77f77d6-a260-4425-95b2-e610394f707e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00064cf4-48bc-48ef-aa0c-b454a5ef5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00064cf4-48bc-48ef-aa0c-b454a5ef5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b73d72a-31eb-48ae-b611-a6cecb26558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:00 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Volume c77f77d6-a260-4425-95b2-e610394f707e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77f77d6-a260-4425-95b2-e610394f707e', 'volume_size': 1} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-206530847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f77d6-a260-4425-95b2-e610394f707e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d708068b20444bb6cc9760454ce341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:00Z,use_quota=True,user_id='0c415041ab5845f2ae2efb51280d7c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Creating volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:57:00 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:00 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e 1073741824 Jul 11 17:57:00 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-bcc438ec-67af-4a57-9585-eadf640204a3 req-cd70ddab-eccd-40eb-aa62-0ab2af61fb2b tempest-AttachVolumeTestJSON-1296521946 None] attachment_update completed successfully. Jul 11 17:57:00 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e17bb53-0100-4b05-a56c-0119d7f75241" returned: 0 in 0.756s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "cinder-quobyte-1e17bb53-0100-4b05-a56c-0119d7f75241" released by "delete_volume" :: held 1.774s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Created reservations ['18005f78-f1f9-4907-8d19-8111fa1500c5', '00129650-5691-4918-8857-78a707e7c0da', '20159afa-ffa0-4c21-922e-f17e1510c638', 'f991b79e-740d-436e-8de4-b3c1d664bff7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:00 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:00 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:01 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e 1073741824" returned: 0 in 1.051s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:01 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e Jul 11 17:57:01 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:01 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Deleted volume successfully. Jul 11 17:57:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-111b2d0c-7ad5-42b8-9ed3-c997c79acbb6 tempest-VolumeQuotasAdminTestJSON-1782355826 None] Lock "cinder-1e17bb53-0100-4b05-a56c-0119d7f75241-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:02 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b73d72a-31eb-48ae-b611-a6cecb26558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77f77d6-a260-4425-95b2-e610394f707e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f4ff23-7c5c-4f21-832c-7d7b6b94de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:02 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Volume volume-c77f77d6-a260-4425-95b2-e610394f707e (c77f77d6-a260-4425-95b2-e610394f707e): created successfully Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f4ff23-7c5c-4f21-832c-7d7b6b94de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Flow 'volume_create_manager' (989bdbb2-f0e1-4358-b305-712f9a6d6408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9fd0b2bd-7179-4c16-a0cb-c4602132102e tempest-SnapshotsActionsTest-1940388522 None] Created volume successfully. Jul 11 17:57:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Creating offline snapshot fd9f99f1-4f23-4c32-b045-212b5bdf521e of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:57:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a0660a-3b01-46b2-94ea-393736a72fe0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:03 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e Jul 11 17:57:03 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:04 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:04 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e 1G Jul 11 17:57:04 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (f86e76b5-9d73-4765-bd62-e9c55e8574ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbb542-848b-46b5-94d3-9ecb2fa3a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbb542-848b-46b5-94d3-9ecb2fa3a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-261031213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520c7a4e-36b4-437c-965f-e9db58220f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:05Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4fb356-b9ad-4a87-87a7-4e972798a7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4fb356-b9ad-4a87-87a7-4e972798a7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecca3f1b-17ac-4826-a5e5-97ed67fe3c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecca3f1b-17ac-4826-a5e5-97ed67fe3c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520c7a4e-36b4-437c-965f-e9db58220f2f', 'volume_name': 'volume-520c7a4e-36b4-437c-965f-e9db58220f2f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfb4b1d-917f-453d-b471-d538d7eeb07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfb4b1d-917f-453d-b471-d538d7eeb07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97834cae-ea04-4ff2-9a79-084b972040f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:05 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Volume 520c7a4e-36b4-437c-965f-e9db58220f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520c7a4e-36b4-437c-965f-e9db58220f2f', 'volume_size': 1} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:05 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e 1G" returned: 0 in 1.108s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:05 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:05 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:06 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:06 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e is being set with open permissions: ugo+rw Jul 11 17:57:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:06 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:06 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:06 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:07 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info Jul 11 17:57:07 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:07 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:07 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info is being set with open permissions: ugo+rw Jul 11 17:57:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:07 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info Jul 11 17:57:07 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:08 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.info" returned: 0 in 0.703s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-261031213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520c7a4e-36b4-437c-965f-e9db58220f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e2f09dc09d4a47b372a000d91f9061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:05Z,use_quota=True,user_id='4b2ea3f542b4438eafaf87b4846a04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Creating volume 520c7a4e-36b4-437c-965f-e9db58220f2f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:57:08 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:57:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:08 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f 1073741824 Jul 11 17:57:08 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8c06b30c-38ab-41cb-92a0-08ce0cf7816f tempest-SnapshotsActionsTest-1940388522 None] Create snapshot completed successfully Jul 11 17:57:09 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f 1073741824" returned: 0 in 1.135s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:09 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f Jul 11 17:57:09 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Flow 'volume_create_manager' (df957f11-b71b-47f9-89e2-495f30c82928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0fddc6-91ff-48f2-9ae5-4d6694a33aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0fddc6-91ff-48f2-9ae5-4d6694a33aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1103256778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6e915f-bab0-4f2b-bce9-26e9f475e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0553d625826c4506a690af8014498af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:10Z,use_quota=True,user_id='753c0cd918c84811b83b050ee2b5cf4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53f216e-c6db-4649-9125-9d65fc5a0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53f216e-c6db-4649-9125-9d65fc5a0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce5543f-d2a5-4fce-9e5e-222d7441c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce5543f-d2a5-4fce-9e5e-222d7441c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6e915f-bab0-4f2b-bce9-26e9f475e64a', 'volume_name': 'volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7506469-0c52-4afb-98d1-0075dc4cc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7506469-0c52-4afb-98d1-0075dc4cc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9360af0e-19ec-4b11-8a7d-ccc990929270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Volume 1a6e915f-bab0-4f2b-bce9-26e9f475e64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a', 'volume_size': 1} Jul 11 17:57:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:10 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f" returned: 0 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97834cae-ea04-4ff2-9a79-084b972040f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520c7a4e-36b4-437c-965f-e9db58220f2f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521245ef-a2cd-44a4-b681-711c19550cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Creating offline snapshot c8d844b8-73cd-46a3-8214-62bfa02de315 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[42599905-209f-4f12-8621-65738d021822]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Volume volume-520c7a4e-36b4-437c-965f-e9db58220f2f (520c7a4e-36b4-437c-965f-e9db58220f2f): created successfully Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521245ef-a2cd-44a4-b681-711c19550cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Flow 'volume_create_manager' (f86e76b5-9d73-4765-bd62-e9c55e8574ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-48eec9a2-b74e-4ed4-972b-55af15bffbc8 tempest-AttachVolumeTestJSON-1296521946 None] Created volume successfully. Jul 11 17:57:10 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:10 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:11 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:11 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 1G Jul 11 17:57:11 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:12 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 1G" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:12 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 Jul 11 17:57:12 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:12 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315" returned: 0 in 0.761s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:12 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 is being set with open permissions: ugo+rw Jul 11 17:57:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:13 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 Jul 11 17:57:13 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:13 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=77,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1103256778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6e915f-bab0-4f2b-bce9-26e9f475e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0553d625826c4506a690af8014498af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:57:10Z,use_quota=True,user_id='753c0cd918c84811b83b050ee2b5cf4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Creating volume 1a6e915f-bab0-4f2b-bce9-26e9f475e64a {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:57:13 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:13 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a 1073741824 Jul 11 17:57:13 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4f9f9b99-bd2d-4dae-94e1-b77a385605d7 tempest-SnapshotsActionsTest-1940388522 None] Create snapshot completed successfully Jul 11 17:57:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:14 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a 1073741824" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:14 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a Jul 11 17:57:14 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-c8d844b8-73cd-46a3-8214-62bfa02de315-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-c8d844b8-73cd-46a3-8214-62bfa02de315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-c8d844b8-73cd-46a3-8214-62bfa02de315" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c8d844b8-73cd-46a3-8214-62bfa02de315" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Deleting offline snapshot c8d844b8-73cd-46a3-8214-62bfa02de315 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] snapshot_file for this snap is: volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d586d-f1c0-4cf9-9da3-a2cf3de97728]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:15 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 Jul 11 17:57:15 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:15 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" returned: 0 in 0.752s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.602s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9360af0e-19ec-4b11-8a7d-ccc990929270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39309617-7609-486b-8ee2-f899e70359d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[989bce9f-7950-4675-b4b8-e78aedb76c99]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:15 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Volume volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a (1a6e915f-bab0-4f2b-bce9-26e9f475e64a): created successfully Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39309617-7609-486b-8ee2-f899e70359d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Flow 'volume_create_manager' (df957f11-b71b-47f9-89e2-495f30c82928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:57:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6889fb25-c9ff-406c-b2b7-f564513acc04 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Created volume successfully. Jul 11 17:57:15 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f Jul 11 17:57:15 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:15 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315" returned: 0 in 0.907s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99231b-4018-4344-8cdf-36176738c54e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:16 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:16 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:16 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f" returned: 0 in 1.029s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-520c7a4e-36b4-437c-965f-e9db58220f2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84849eb5-18c5-4afc-a7f7-bc3985222d18', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:57:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-89942da0-6c99-42cb-8f6e-49953f7b1faa req-df775d87-0367-4dc9-895f-185a9718753c tempest-AttachVolumeTestJSON-1296521946 None] attachment_update completed successfully. Jul 11 17:57:16 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 0.925s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:16 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 Jul 11 17:57:16 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Acquiring lock "cinder-1a6e915f-bab0-4f2b-bce9-26e9f475e64a-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "cinder-1a6e915f-bab0-4f2b-bce9-26e9f475e64a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Acquiring lock "cinder-quobyte-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "cinder-quobyte-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7864fb65-bbb6-4e0a-9bfd-d99ac97ea5f7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:17 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a Jul 11 17:57:17 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:17 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315" returned: 0 in 1.133s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:18 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315 Jul 11 17:57:18 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:18 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" returned: 0 in 0.970s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:18 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a Jul 11 17:57:18 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:18 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.c8d844b8-73cd-46a3-8214-62bfa02de315" returned: 0 in 0.735s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c8d844b8-73cd-46a3-8214-62bfa02de315" released by "_delete_snapshot" :: held 3.851s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_snapshot" :: held 3.885s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Created reservations ['c4bd86ce-1a1e-41b3-b709-a44f6b43632f', '9b4846c8-4464-45e7-be5f-1f66e51355d1', '7200be58-0d88-422e-a16a-f929ccbe7ba4', '6aa6de9d-734a-4841-85ae-108ba304c28a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:18 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Delete snapshot completed successfully. Jul 11 17:57:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d53037b6-c345-4c27-8acd-f86c428b0ffe tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-c8d844b8-73cd-46a3-8214-62bfa02de315-delete_snapshot" released by "delete_snapshot" :: held 4.055s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:19 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" returned: 0 in 0.681s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "cinder-quobyte-1a6e915f-bab0-4f2b-bce9-26e9f475e64a" released by "delete_volume" :: held 1.740s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Created reservations ['e028be00-03d4-4785-bafb-fd700dcf0663', 'ca8047b0-720a-4d0d-9e9e-e2c85c25fe81', '4f26d8ec-57a3-47f4-b0bd-d05375ae04ff', '643eadd4-99e1-4aa8-bd95-63e4e0ebe138'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:19 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:19 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Creating offline snapshot d718c638-da6f-4c0b-addb-d29510c1fab8 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[63220a4e-d77a-483b-8cd7-f87837c87a47]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:20 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:20 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:20 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Deleted volume successfully. Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24139049-6a8d-40e0-8970-9e0078349c32 tempest-VolumeQuotasNegativeTestJSON-1208867168 None] Lock "cinder-1a6e915f-bab0-4f2b-bce9-26e9f475e64a-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:20 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.092s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:20 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 1G Jul 11 17:57:20 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:22 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 1G" returned: 0 in 1.292s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:22 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 Jul 11 17:57:22 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:23 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:23 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 is being set with open permissions: ugo+rw Jul 11 17:57:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:23 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 Jul 11 17:57:23 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-9c5eebb8-c170-48d6-a0c8-981a430d0648 req-a4e7a82e-4ff9-4440-b04d-2ed65f810dde tempest-AttachVolumeTestJSON-1296521946 None] Terminate volume connection completed successfully. Jul 11 17:57:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-9c5eebb8-c170-48d6-a0c8-981a430d0648 req-a4e7a82e-4ff9-4440-b04d-2ed65f810dde tempest-AttachVolumeTestJSON-1296521946 None] Deleting attachment 3308c6fe-773a-42c3-ae80-a325b347db79. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:57:23 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8" returned: 0 in 0.687s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-64855ae8-b072-46d7-b34d-40fdf00f14b1 tempest-SnapshotsActionsTest-1940388522 None] Create snapshot completed successfully Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-d718c638-da6f-4c0b-addb-d29510c1fab8-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-d718c638-da6f-4c0b-addb-d29510c1fab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-d718c638-da6f-4c0b-addb-d29510c1fab8" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-d718c638-da6f-4c0b-addb-d29510c1fab8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Deleting offline snapshot d718c638-da6f-4c0b-addb-d29510c1fab8 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] snapshot_file for this snap is: volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dacdf07-5e88-4fb3-816d-0e178185b291]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:25 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 Jul 11 17:57:25 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-900bfe6c-2774-47a9-995a-caa18c5acc30 req-82a939a8-59bc-427c-ad3d-b04836196a2f tempest-AttachVolumeTestJSON-1296521946 None] Terminate volume connection completed successfully. Jul 11 17:57:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-900bfe6c-2774-47a9-995a-caa18c5acc30 req-82a939a8-59bc-427c-ad3d-b04836196a2f tempest-AttachVolumeTestJSON-1296521946 None] Deleting attachment 84849eb5-18c5-4afc-a7f7-bc3985222d18. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 17:57:26 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8" returned: 0 in 1.120s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:26 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e7df10-a8c9-4f95-b154-adb6eacedf2b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:26 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:26 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:27 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.100s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:27 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 Jul 11 17:57:27 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:28 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8" returned: 0 in 1.072s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:28 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8 Jul 11 17:57:28 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:29 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.d718c638-da6f-4c0b-addb-d29510c1fab8" returned: 0 in 0.855s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-d718c638-da6f-4c0b-addb-d29510c1fab8" released by "_delete_snapshot" :: held 4.287s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_snapshot" :: held 4.318s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:29 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Created reservations ['bb385873-96ef-47c5-8dda-0d9ee3af2b27', 'b0f352f9-9c9c-4a32-89e4-a5cf7d829674', '19ed95b4-1b6a-4d3e-806b-258836d33fe1', 'bd0a226b-28e2-49bf-b23c-cb914180b6dc'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Delete snapshot completed successfully. Jul 11 17:57:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8faeaf2e-e3e7-465e-88c2-e58bef7ee067 tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-d718c638-da6f-4c0b-addb-d29510c1fab8-delete_snapshot" released by "delete_snapshot" :: held 4.536s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Creating offline snapshot 7bb4b509-01bd-4d6d-9b77-95a833e65f12 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:57:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[511dfbb3-9f39-4eca-a502-4339231da693]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:31 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:31 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:32 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.185s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:32 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 1G Jul 11 17:57:32 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:33 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 1G" returned: 0 in 1.069s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:33 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 Jul 11 17:57:33 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:34 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12" returned: 0 in 0.944s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:34 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:34 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:34 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 is being set with open permissions: ugo+rw Jul 11 17:57:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:34 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 Jul 11 17:57:34 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:35 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12" returned: 0 in 1.207s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.574s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c4facfb5-41d5-4009-80a2-d306d96a3f47 tempest-SnapshotsActionsTest-1940388522 None] Create snapshot completed successfully Jul 11 17:57:35 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.687s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 8 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:57:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-7bb4b509-01bd-4d6d-9b77-95a833e65f12-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-7bb4b509-01bd-4d6d-9b77-95a833e65f12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-7bb4b509-01bd-4d6d-9b77-95a833e65f12" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-7bb4b509-01bd-4d6d-9b77-95a833e65f12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Deleting offline snapshot 7bb4b509-01bd-4d6d-9b77-95a833e65f12 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] snapshot_file for this snap is: volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5f5a26-0bb9-4878-a5ff-0d5337eedaec]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:36 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 Jul 11 17:57:36 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:37 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12" returned: 0 in 1.326s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[514671a5-df81-4ac2-bb4a-205d4c4e0851]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:38 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:38 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:39 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.485s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:39 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 Jul 11 17:57:39 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-520c7a4e-36b4-437c-965f-e9db58220f2f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-520c7a4e-36b4-437c-965f-e9db58220f2f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-quobyte-520c7a4e-36b4-437c-965f-e9db58220f2f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-520c7a4e-36b4-437c-965f-e9db58220f2f" acquired by "delete_volume" :: waited 0.075s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9766bfe0-dbd7-4937-8937-87a0e9d807a2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:40 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f Jul 11 17:57:40 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:41 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12" returned: 0 in 1.957s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:41 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f" returned: 0 in 1.433s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:41 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12 Jul 11 17:57:41 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:41 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f Jul 11 17:57:41 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:43 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:43 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-520c7a4e-36b4-437c-965f-e9db58220f2f" returned: 0 in 1.915s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.7bb4b509-01bd-4d6d-9b77-95a833e65f12" returned: 0 in 2.015s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-520c7a4e-36b4-437c-965f-e9db58220f2f" released by "delete_volume" :: held 3.451s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-7bb4b509-01bd-4d6d-9b77-95a833e65f12" released by "_delete_snapshot" :: held 6.973s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_snapshot" :: held 7.012s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Created reservations ['feb93800-0c81-4109-8ab0-8487722047fa', '003f69d9-dee7-4f71-838f-541b243dce43', 'b274e27f-6ce8-4293-8aeb-fe89e0633f5d', '8f9a9c31-6319-49a3-866b-703f3fd28233'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Created reservations ['dc33f209-7c4a-4e3b-864a-2320db5f12f4', 'd6172f80-b14c-4b63-93a4-a01824d7b553', '25d7f6c9-4f39-4fd0-aace-a4e9fa1af989', '4ef4efb3-3c78-4640-b893-bb04af134ef2'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:43 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:43 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=87,cinder:UPDATE=100,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:57:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Delete snapshot completed successfully. Jul 11 17:57:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-860b1b4c-d730-4862-807e-36968d7f8dce tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-7bb4b509-01bd-4d6d-9b77-95a833e65f12-delete_snapshot" released by "delete_snapshot" :: held 7.471s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-quobyte-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" acquired by "delete_volume" :: waited 0.072s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f827e-08ee-48f7-bae4-9df69330c335]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Creating offline snapshot 0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41dff32-c8be-433f-b7b5-cc87655080b8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:45 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 Jul 11 17:57:45 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:45 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.877s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Deleted volume successfully. Jul 11 17:57:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4e7e6db1-2087-4210-8e99-3b85077c374d tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-520c7a4e-36b4-437c-965f-e9db58220f2f-delete_volume" released by "delete_volume" :: held 5.958s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:45 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:45 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:46 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" returned: 0 in 1.415s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:46 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4 Jul 11 17:57:46 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:47 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.965s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:47 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 1G Jul 11 17:57:47 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:47 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" returned: 0 in 1.028s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4" released by "delete_volume" :: held 2.563s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Created reservations ['a22db152-2732-4405-997c-11a8cedb39a5', 'd7db2613-5dfd-45e2-807e-dbe6d3cb8f61', 'a4b2f3e7-aaee-428b-9473-642923bc0341', '63aab30a-c5a2-4b02-b668-61b5f83b9ee6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:47 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:47 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:48 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 1G" returned: 0 in 1.246s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:48 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 Jul 11 17:57:48 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:48 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.872s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:48 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Deleted volume successfully. Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0cbf8ce0-ae9f-45d1-b120-75360c5ff331 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-a8ad5300-5c9c-49ee-afdc-0fae32b7ddb4-delete_volume" released by "delete_volume" :: held 3.925s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-627f3b49-c108-4b08-99b5-75739b2830c0-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-627f3b49-c108-4b08-99b5-75739b2830c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "cinder-quobyte-627f3b49-c108-4b08-99b5-75739b2830c0" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-627f3b49-c108-4b08-99b5-75739b2830c0" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98f347e-1697-4fca-9145-ef8ed1974e42]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:49 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 Jul 11 17:57:49 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:49 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" returned: 0 in 1.223s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:49 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 is being set with open permissions: ugo+rw Jul 11 17:57:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:49 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 Jul 11 17:57:49 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:50 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0" returned: 0 in 1.149s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:50 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0 Jul 11 17:57:50 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:50 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" returned: 0 in 1.029s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.652s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c9861296-4648-4d20-a4ff-546c6b190111 tempest-SnapshotsActionsTest-1940388522 None] Create snapshot completed successfully Jul 11 17:57:51 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-627f3b49-c108-4b08-99b5-75739b2830c0" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-quobyte-627f3b49-c108-4b08-99b5-75739b2830c0" released by "delete_volume" :: held 2.189s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Created reservations ['2ba387da-a8db-4fb1-8fab-7d26e5f9e864', 'cdd315d7-d6b5-4ed1-9060-7619c7eb7df4', 'cd89a580-e73c-479b-9791-add77e495ede', '6960c58a-f11c-45ce-ab8c-a4901b45c57d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:51 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:57:51 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Acquiring lock "cinder-quobyte-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Deleting offline snapshot 0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:57:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] snapshot_file for this snap is: volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:57:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f876fd-3436-43d3-9fc7-44dcb221de0f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:52 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 Jul 11 17:57:52 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:52 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:52 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:57:52 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Deleted volume successfully. Jul 11 17:57:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-10788e26-96a0-42b4-b3f1-11a6be73cbf4 tempest-AttachVolumeTestJSON-1296521946 None] Lock "cinder-627f3b49-c108-4b08-99b5-75739b2830c0-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:53 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" returned: 0 in 1.104s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79707fa9-0e90-4ae7-bb10-66e0f15fd821]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:53 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:53 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:54 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.074s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:54 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 Jul 11 17:57:54 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:55 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" returned: 0 in 1.132s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:55 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0 Jul 11 17:57:55 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:56 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" returned: 0 in 0.937s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0" released by "_delete_snapshot" :: held 4.406s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_snapshot" :: held 4.449s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:56 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Created reservations ['b7b19d6c-9f4f-40d3-abd3-15c652759560', '5b0457ce-17d2-4ef0-bf30-2e645d375c31', '9aa6d4bd-bb7c-4270-bf9e-cba28694a0ad', '51aa9fa7-b532-422e-b4bd-e1c8b94d214f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:57:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Delete snapshot completed successfully. Jul 11 17:57:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-08104b53-7b4c-4d63-8a86-0e5b9a6bc95f tempest-SnapshotsActionsTest-288167274 None] Lock "cinder-0b4d9eaa-c74a-4db4-90fc-8a871f8ccbe0-delete_snapshot" released by "delete_snapshot" :: held 4.707s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "cinder-fd9f99f1-4f23-4c32-b045-212b5bdf521e-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-fd9f99f1-4f23-4c32-b045-212b5bdf521e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "cinder-quobyte-fd9f99f1-4f23-4c32-b045-212b5bdf521e" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-fd9f99f1-4f23-4c32-b045-212b5bdf521e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Deleting offline snapshot fd9f99f1-4f23-4c32-b045-212b5bdf521e of volume c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] snapshot_file for this snap is: volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa020065-5d7d-4039-bca9-df9bd72ee362]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:58 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:57:58 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:57:59 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 11 17:57:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.327s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:57:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f77d6-a260-4425-95b2-e610394f707e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:57:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7179ee85-af8b-4630-9406-d408909a5534]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:57:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:57:59 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e Jul 11 17:57:59 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Flow 'volume_create_manager' (07ed7add-dd6a-4963-ad7a-dc846ac6f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f3af86-2b50-43b4-a9f6-0550b00f2bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f3af86-2b50-43b4-a9f6-0550b00f2bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1606454257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6088cf74-4d00-4b6c-a4b4-91e00c43deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b2a94120cd4dfa9dc80c93fd3d866c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:01Z,use_quota=True,user_id='bcea5b2fb869426e992d70731f50cd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4468da9-3618-4acd-a35e-387fcc9aaeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4468da9-3618-4acd-a35e-387fcc9aaeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e728a-5e70-40a1-ade8-6d4d899edac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e728a-5e70-40a1-ade8-6d4d899edac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6088cf74-4d00-4b6c-a4b4-91e00c43deb2', 'volume_name': 'volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c03b5-f6d8-423f-9351-bcbb41905b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c03b5-f6d8-423f-9351-bcbb41905b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2567a279-5fe1-4422-85bd-c268061a49a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Volume 6088cf74-4d00-4b6c-a4b4-91e00c43deb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2', 'volume_size': 1} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1606454257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6088cf74-4d00-4b6c-a4b4-91e00c43deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b2a94120cd4dfa9dc80c93fd3d866c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:01Z,use_quota=True,user_id='bcea5b2fb869426e992d70731f50cd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Creating volume 6088cf74-4d00-4b6c-a4b4-91e00c43deb2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:01 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:01 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e" returned: 0 in 1.951s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:01 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 1073741824 Jul 11 17:58:01 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:01 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:58:01 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:02 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.541s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:02 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e Jul 11 17:58:02 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:03 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 1073741824" returned: 0 in 2.020s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:03 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 Jul 11 17:58:03 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:03 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e.fd9f99f1-4f23-4c32-b045-212b5bdf521e" returned: 0 in 1.048s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-fd9f99f1-4f23-4c32-b045-212b5bdf521e" released by "_delete_snapshot" :: held 6.102s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_snapshot" :: held 6.146s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Created reservations ['d902a19d-ede1-4a37-b6f3-0f91f8a7b947', '5ddfafc6-9751-4884-95aa-bb523f0844f2', '4f3e263d-d6a3-4927-b60d-620b2a842a2f', '8411f05d-7c42-4962-95a0-4ad6413f0832'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Delete snapshot completed successfully. Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b5fddf99-dd10-4ca5-8c3b-42b8a3e453e0 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-fd9f99f1-4f23-4c32-b045-212b5bdf521e-delete_snapshot" released by "delete_snapshot" :: held 6.482s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "cinder-c77f77d6-a260-4425-95b2-e610394f707e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:04 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-c77f77d6-a260-4425-95b2-e610394f707e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" returned: 0 in 1.275s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] <== create_volume: return (3359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.361s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2567a279-5fe1-4422-85bd-c268061a49a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50ee6ef-d359-4e39-904b-2611ae105ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Volume volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 (6088cf74-4d00-4b6c-a4b4-91e00c43deb2): created successfully Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50ee6ef-d359-4e39-904b-2611ae105ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Flow 'volume_create_manager' (07ed7add-dd6a-4963-ad7a-dc846ac6f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bfb221e0-cf10-4156-a436-2fdf1be049ba tempest-ServerRescueNegativeTestJSON-1104896645 None] Created volume successfully. Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[950abfe5-b7c0-4c74-927e-eba0a2fd8d99]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:04 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e Jul 11 17:58:04 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:06 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e" returned: 0 in 1.527s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:06 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e Jul 11 17:58:06 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:07 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c77f77d6-a260-4425-95b2-e610394f707e" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-quobyte-c77f77d6-a260-4425-95b2-e610394f707e" released by "delete_volume" :: held 2.482s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Created reservations ['2a528c02-e959-4759-8b01-ef158128596f', 'e1b11c9a-e0b6-4753-8b96-e82ffac14910', '2c1e1f92-bab5-4995-ab01-50d0adcf1f4a', '89b30d4c-a7d0-4944-8fdf-bc394137e23d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:07 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:07 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:08 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.747s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:08 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Deleted volume successfully. Jul 11 17:58:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ef829c2a-65b8-4857-8ed7-7360ec89fb98 tempest-SnapshotsActionsTest-1940388522 None] Lock "cinder-c77f77d6-a260-4425-95b2-e610394f707e-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=78,cinder:SELECT=67,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Flow 'volume_create_manager' (4a5f3a3a-f2f1-4422-8875-a43e4e1a012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54e987c-5588-4c58-b6ba-4352207ce3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54e987c-5588-4c58-b6ba-4352207ce3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1859962598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140b4e86-fc0f-4264-a2f8-fbec869eb0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc15d533e1f3456292dbe783b73bdb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:15Z,use_quota=True,user_id='0a4e26de6959489f996ab07a7f6599a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152f14ba-adc6-4b40-9f0e-5f072f6fa461),volume_type_id=152f14ba-adc6-4b40-9f0e-5f072f6fa461)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083d75b4-2b3f-4e68-819a-f3fe49808d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083d75b4-2b3f-4e68-819a-f3fe49808d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73d141b-6951-42a7-ad45-fda020d6b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73d141b-6951-42a7-ad45-fda020d6b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140b4e86-fc0f-4264-a2f8-fbec869eb0ae', 'volume_name': 'volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5195b29-8e61-4424-8bab-43449e82458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5195b29-8e61-4424-8bab-43449e82458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2da449-db76-467d-8320-bc995362887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Volume 140b4e86-fc0f-4264-a2f8-fbec869eb0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae', 'volume_size': 1} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1859962598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140b4e86-fc0f-4264-a2f8-fbec869eb0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc15d533e1f3456292dbe783b73bdb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:15Z,use_quota=True,user_id='0a4e26de6959489f996ab07a7f6599a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152f14ba-adc6-4b40-9f0e-5f072f6fa461),volume_type_id=152f14ba-adc6-4b40-9f0e-5f072f6fa461)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Creating volume 140b4e86-fc0f-4264-a2f8-fbec869eb0ae {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:14 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae 1073741824 Jul 11 17:58:14 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:16 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae 1073741824" returned: 0 in 1.453s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:16 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae Jul 11 17:58:16 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:17 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" returned: 0 in 1.087s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2da449-db76-467d-8320-bc995362887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3ed44-4ef2-4678-8519-795c725eb454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Volume volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae (140b4e86-fc0f-4264-a2f8-fbec869eb0ae): created successfully Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3ed44-4ef2-4678-8519-795c725eb454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Flow 'volume_create_manager' (4a5f3a3a-f2f1-4422-8875-a43e4e1a012e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d75df4c5-c203-4b0f-a418-8114bb23156c tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Created volume successfully. Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:19 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:19 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:20 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-eade7c28-4a42-4bd8-9d2f-bdfb1609d5c8 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Retype volume completed successfully. Jul 11 17:58:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "cinder-140b4e86-fc0f-4264-a2f8-fbec869eb0ae-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "cinder-140b4e86-fc0f-4264-a2f8-fbec869eb0ae-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "cinder-quobyte-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "cinder-quobyte-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" acquired by "delete_volume" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac09619-cba4-48e1-a34e-d924ae73842e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:21 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae Jul 11 17:58:21 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:22 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" returned: 0 in 1.560s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:22 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae Jul 11 17:58:22 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:23 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" returned: 0 in 0.772s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "cinder-quobyte-140b4e86-fc0f-4264-a2f8-fbec869eb0ae" released by "delete_volume" :: held 2.421s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:23 devstack cinder-volume[86932]: WARNING cinder.quota [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:58:23 devstack cinder-volume[86932]: WARNING cinder.quota [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Created reservations ['9956d6a6-b3bc-4db2-85bb-6d23ec74baaa', 'ffc01747-dc75-4c71-ba56-a91d405182e3', '49fb76bf-8b82-4ba6-8c53-d251f477a6c8', '8a90a376-bdbc-4ded-b6b5-a9a4955cc120'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:23 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:23 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:24 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.147s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:24 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Deleted volume successfully. Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f38c043c-7b6b-4e91-8110-8df27bed5f55 tempest-VolumeRetypeWithoutMigrationTest-445989396 None] Lock "cinder-140b4e86-fc0f-4264-a2f8-fbec869eb0ae-delete_volume" released by "delete_volume" :: held 4.032s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (00e0579d-4f86-49bd-a923-dc8122a46ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7f0503-cee7-4d80-9fae-05700d1e0016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7f0503-cee7-4d80-9fae-05700d1e0016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1056523210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f99147-fc25-4cef-b78d-3fc8bdd2a03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:25Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a079ffd-bf87-4af9-a60c-52a7f3453d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a079ffd-bf87-4af9-a60c-52a7f3453d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b8b3dd-1b94-4b0f-b31b-602fa81114db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b8b3dd-1b94-4b0f-b31b-602fa81114db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f99147-fc25-4cef-b78d-3fc8bdd2a03d', 'volume_name': 'volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7907a4-6f28-49a3-a120-1b9a69520fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7907a4-6f28-49a3-a120-1b9a69520fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfd6b2d-34ca-4392-80e6-86b53f572004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Volume 89f99147-fc25-4cef-b78d-3fc8bdd2a03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d', 'volume_size': 1} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1056523210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f99147-fc25-4cef-b78d-3fc8bdd2a03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:25Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Creating volume 89f99147-fc25-4cef-b78d-3fc8bdd2a03d {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:25 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:25 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d 1073741824 Jul 11 17:58:25 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:27 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d 1073741824" returned: 0 in 1.552s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:27 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d Jul 11 17:58:27 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Acquiring lock "cinder-6088cf74-4d00-4b6c-a4b4-91e00c43deb2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "cinder-6088cf74-4d00-4b6c-a4b4-91e00c43deb2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Acquiring lock "cinder-quobyte-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "cinder-quobyte-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" acquired by "delete_volume" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4edf80-27ba-44c4-9656-33cf05164e16]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:28 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 Jul 11 17:58:28 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:29 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" returned: 0 in 1.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (3433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.438s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfd6b2d-34ca-4392-80e6-86b53f572004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0986ba36-d742-48b0-9261-7741fdc60295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Volume volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d (89f99147-fc25-4cef-b78d-3fc8bdd2a03d): created successfully Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0986ba36-d742-48b0-9261-7741fdc60295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (00e0579d-4f86-49bd-a923-dc8122a46ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5957730b-519b-4d7e-8279-669558f6d601 tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a2b20d00-ba00-4917-a7f6-17f97428cb1c tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" by "attach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a2b20d00-ba00-4917-a7f6-17f97428cb1c tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" acquired by "attach_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a2b20d00-ba00-4917-a7f6-17f97428cb1c tempest-VolumesActionsTest-1228349118 None] Attaching volume 89f99147-fc25-4cef-b78d-3fc8bdd2a03d to instance dcccbcb5-bb19-45b5-b421-bac32bb59ea1 at mountpoint /dev/vdb on host None. Jul 11 17:58:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a2b20d00-ba00-4917-a7f6-17f97428cb1c tempest-VolumesActionsTest-1228349118 None] Attach volume completed successfully. Jul 11 17:58:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a2b20d00-ba00-4917-a7f6-17f97428cb1c tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" released by "attach_volume" :: held 0.252s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:30 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" returned: 0 in 2.264s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:30 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2 Jul 11 17:58:30 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:31 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" returned: 0 in 1.100s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "cinder-quobyte-6088cf74-4d00-4b6c-a4b4-91e00c43deb2" released by "delete_volume" :: held 3.459s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Created reservations ['ebd2ddae-008a-425e-8a61-b24f3d8781fd', '11aeff6a-2c0e-4346-a108-8ace6de275ef', 'bee4a528-4c04-4ad7-a455-34a4b58f7f1d', 'b5dbbcdf-11c2-4661-bfe1-02bac6fa8be1'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:31 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:31 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Terminate volume connection completed successfully. Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" by "detach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Detaching volume 89f99147-fc25-4cef-b78d-3fc8bdd2a03d from instance dcccbcb5-bb19-45b5-b421-bac32bb59ea1. Jul 11 17:58:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Detach volume completed successfully. Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4d4426fb-2884-4832-b7e5-82be3f13a047 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:32 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.257s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Deleted volume successfully. Jul 11 17:58:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-628e12ec-dd0c-4c20-9c21-f95711f0e698 tempest-ServerRescueNegativeTestJSON-1104896645 None] Lock "cinder-6088cf74-4d00-4b6c-a4b4-91e00c43deb2-delete_volume" released by "delete_volume" :: held 5.130s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-23196719-d859-456a-876b-3ad05fa6afaa tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" by "detach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-23196719-d859-456a-876b-3ad05fa6afaa tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-23196719-d859-456a-876b-3ad05fa6afaa tempest-VolumesActionsTest-1228349118 None] Volume detach called, but volume not attached. Jul 11 17:58:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-23196719-d859-456a-876b-3ad05fa6afaa tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:34 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:34 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-quobyte-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-quobyte-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" acquired by "delete_volume" :: waited 0.049s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c14bc-c7da-4f54-b2fd-ac9435d665f6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:35 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d Jul 11 17:58:35 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:36 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 2.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:36 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:36 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:58:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 8 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:58:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:58:37 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" returned: 0 in 2.821s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:37 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d Jul 11 17:58:37 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:38 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" returned: 0 in 1.456s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-quobyte-89f99147-fc25-4cef-b78d-3fc8bdd2a03d" released by "delete_volume" :: held 4.422s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:38 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Created reservations ['0dfbb71e-95e4-4d36-bc8d-687561bedebb', '6360f468-52be-449c-8768-229af9ead034', 'aae75a33-87ce-49cf-ac03-d29dd7bbbc48', '22c8767c-bda0-462c-bacb-35f2d3f19caa'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:39 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:39 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Flow 'volume_create_manager' (f4d91802-c079-4174-9989-ce1d5dc69b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1af6ca-8ea5-4830-af66-b749359fe803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1af6ca-8ea5-4830-af66-b749359fe803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1569674128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1fa75e-0868-4b67-8c17-7ec649778acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4376e00f04fb696cacd1fd7cafbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:39Z,use_quota=True,user_id='cba64813a41c4a48a1bd452ea882736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d83f721-7490-4b69-befa-4888652cb2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d83f721-7490-4b69-befa-4888652cb2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0fa4d8-9eb8-43f0-8900-8a76e17710e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0fa4d8-9eb8-43f0-8900-8a76e17710e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1fa75e-0868-4b67-8c17-7ec649778acd', 'volume_name': 'volume-dc1fa75e-0868-4b67-8c17-7ec649778acd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203c285f-26c7-48ed-b91e-ae34ee74943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203c285f-26c7-48ed-b91e-ae34ee74943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de0a2eb-9abf-4e46-bb30-c6ba8366e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Volume dc1fa75e-0868-4b67-8c17-7ec649778acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1fa75e-0868-4b67-8c17-7ec649778acd', 'volume_size': 1} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1569674128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1fa75e-0868-4b67-8c17-7ec649778acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4376e00f04fb696cacd1fd7cafbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:39Z,use_quota=True,user_id='cba64813a41c4a48a1bd452ea882736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Creating volume dc1fa75e-0868-4b67-8c17-7ec649778acd {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:39 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:39 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd 1073741824 Jul 11 17:58:39 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:40 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.382s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:40 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Deleted volume successfully. Jul 11 17:58:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ddd709c-968d-42b6-9e47-de65aa048fc0 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-89f99147-fc25-4cef-b78d-3fc8bdd2a03d-delete_volume" released by "delete_volume" :: held 6.232s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:40 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd 1073741824" returned: 0 in 1.476s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:41 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd Jul 11 17:58:41 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:41 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de0a2eb-9abf-4e46-bb30-c6ba8366e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1fa75e-0868-4b67-8c17-7ec649778acd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b946ffd1-9fb8-4b44-bb95-b5d8c675228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Volume volume-dc1fa75e-0868-4b67-8c17-7ec649778acd (dc1fa75e-0868-4b67-8c17-7ec649778acd): created successfully Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b946ffd1-9fb8-4b44-bb95-b5d8c675228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Flow 'volume_create_manager' (f4d91802-c079-4174-9989-ce1d5dc69b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d232e14c-95e2-4e88-828b-4ddd9e306586 tempest-VolumesServicesTestJSON-1448920587 None] Created volume successfully. Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Acquiring lock "cinder-dc1fa75e-0868-4b67-8c17-7ec649778acd-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "cinder-dc1fa75e-0868-4b67-8c17-7ec649778acd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Acquiring lock "cinder-quobyte-dc1fa75e-0868-4b67-8c17-7ec649778acd" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "cinder-quobyte-dc1fa75e-0868-4b67-8c17-7ec649778acd" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[04957f26-e746-4530-821f-ec78cee20b63]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:42 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd Jul 11 17:58:42 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:43 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd" returned: 0 in 0.861s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:43 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd Jul 11 17:58:43 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:44 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-dc1fa75e-0868-4b67-8c17-7ec649778acd" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "cinder-quobyte-dc1fa75e-0868-4b67-8c17-7ec649778acd" released by "delete_volume" :: held 1.597s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=79,cinder:SELECT=77,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Created reservations ['6d6624e3-0df0-4b81-be04-06a2039a89fd', '44af4a15-6b34-44c1-8482-fe22f9d05223', '2dbd322d-14e3-4cf8-803e-9d6508970c5e', '047a15ad-2262-48fa-a3bd-7d3919ff903b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:44 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:44 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:45 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.219s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:45 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Deleted volume successfully. Jul 11 17:58:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5906be64-ddd6-4453-a099-63e02d2c900e tempest-VolumesServicesTestJSON-1448920587 None] Lock "cinder-dc1fa75e-0868-4b67-8c17-7ec649778acd-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (24173f31-d7c6-4431-b656-10dc3f92ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a619b77f-8245-40bd-87da-675f751bd07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a619b77f-8245-40bd-87da-675f751bd07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123691000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603c5842-cf2d-4b2f-bdac-feb3a8bcb74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:47Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1be84fc-23a1-4645-8d47-8bff78297b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1be84fc-23a1-4645-8d47-8bff78297b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121899a0-b52a-47f1-89e3-537699cab1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121899a0-b52a-47f1-89e3-537699cab1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603c5842-cf2d-4b2f-bdac-feb3a8bcb74b', 'volume_name': 'volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d012b7-06af-4849-bc4c-c51bb19bccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d012b7-06af-4849-bc4c-c51bb19bccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad62d51f-6b43-4c50-8772-63fcb118371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:47 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Volume 603c5842-cf2d-4b2f-bdac-feb3a8bcb74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b', 'volume_size': 1} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123691000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603c5842-cf2d-4b2f-bdac-feb3a8bcb74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:47Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Creating volume 603c5842-cf2d-4b2f-bdac-feb3a8bcb74b {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:47 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:47 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b 1073741824 Jul 11 17:58:47 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:48 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b 1073741824" returned: 0 in 1.232s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:48 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b Jul 11 17:58:48 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:49 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" returned: 0 in 0.874s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad62d51f-6b43-4c50-8772-63fcb118371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c241fc-f52d-47df-b1f5-340a9f22fb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:49 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Volume volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b (603c5842-cf2d-4b2f-bdac-feb3a8bcb74b): created successfully Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c241fc-f52d-47df-b1f5-340a9f22fb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (24173f31-d7c6-4431-b656-10dc3f92ee52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-46f1ffe4-c655-4393-8b33-7edef009f673 tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-quobyte-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3691a374-9675-429b-8f95-d9911fcaba4d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:50 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b Jul 11 17:58:50 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:51 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" returned: 0 in 1.025s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:51 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b Jul 11 17:58:51 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:52 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" returned: 0 in 0.894s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b" released by "delete_volume" :: held 2.001s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Created reservations ['3d32f0e0-c26c-4909-bc15-7a483ad53916', '5056e206-623a-4d10-878c-f845e81282ac', '5bd14c78-15e9-4649-b8cf-1208420ca42e', '3319e3f7-9d95-4cb2-9dbb-60516a24eb73'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:52 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:52 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Flow 'volume_create_manager' (4c9e2497-5a3a-43e9-9907-c4cdf99f5e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bca3362-158b-4c21-b11f-479c15da3a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bca3362-158b-4c21-b11f-479c15da3a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1804972396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5f9aef-1de0-45a4-9b0b-f8f1311993a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dd27f628ef47089565144cc5139e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:53Z,use_quota=True,user_id='8ebaa95dc259460991d034112c96581f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6f90707-a2d5-45b9-b571-1c950dd13f89),volume_type_id=c6f90707-a2d5-45b9-b571-1c950dd13f89)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcac231-3c12-4858-a8d9-56f158231478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcac231-3c12-4858-a8d9-56f158231478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9d0996-56e1-4736-a75b-f4e94a80bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9d0996-56e1-4736-a75b-f4e94a80bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5f9aef-1de0-45a4-9b0b-f8f1311993a0', 'volume_name': 'volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e76bcc-3402-492a-aa5b-179107adb8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e76bcc-3402-492a-aa5b-179107adb8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8734c8-e980-43b1-8e1a-e57f9184ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Volume 2b5f9aef-1de0-45a4-9b0b-f8f1311993a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0', 'volume_size': 1} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1804972396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5f9aef-1de0-45a4-9b0b-f8f1311993a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dd27f628ef47089565144cc5139e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:53Z,use_quota=True,user_id='8ebaa95dc259460991d034112c96581f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6f90707-a2d5-45b9-b571-1c950dd13f89),volume_type_id=c6f90707-a2d5-45b9-b571-1c950dd13f89)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Creating volume 2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:53 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:53 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 1073741824 Jul 11 17:58:53 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:53 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.085s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:53 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:58:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Deleted volume successfully. Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0699e22-a8fe-41a9-a7d0-4ef3de48daa8 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-603c5842-cf2d-4b2f-bdac-feb3a8bcb74b-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (69b6c355-6eb7-4578-bdb1-d721fe870c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1988c204-97d2-46f8-b99f-c513d5af7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1988c204-97d2-46f8-b99f-c513d5af7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930521158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e638bbc-773c-4ea7-9167-d89077b2a6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:54Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9c6dc5-b0f8-4ea3-8bee-2d3b4ea30662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9c6dc5-b0f8-4ea3-8bee-2d3b4ea30662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc4b102-34b6-4e41-a4a0-b842f6993396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc4b102-34b6-4e41-a4a0-b842f6993396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e638bbc-773c-4ea7-9167-d89077b2a6e2', 'volume_name': 'volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fd86ce-86e5-42be-b285-143f307802e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fd86ce-86e5-42be-b285-143f307802e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b26ca7-b3b4-4968-912d-80a63dfcdea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:54 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Volume 9e638bbc-773c-4ea7-9167-d89077b2a6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2', 'volume_size': 1} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:54 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 1073741824" returned: 0 in 1.148s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:55 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 Jul 11 17:58:55 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:55 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" returned: 0 in 0.693s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930521158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e638bbc-773c-4ea7-9167-d89077b2a6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:58:54Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Creating volume 9e638bbc-773c-4ea7-9167-d89077b2a6e2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:58:55 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:55 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 1073741824 Jul 11 17:58:55 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8734c8-e980-43b1-8e1a-e57f9184ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915437b8-f6ce-48d0-b8ca-90c860884a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Volume volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 (2b5f9aef-1de0-45a4-9b0b-f8f1311993a0): created successfully Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915437b8-f6ce-48d0-b8ca-90c860884a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Flow 'volume_create_manager' (4c9e2497-5a3a-43e9-9907-c4cdf99f5e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ad94360f-de5f-4fad-a90d-292659297f88 tempest-VolumeTypesAccessTest-268811239 None] Created volume successfully. Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Acquiring lock "cinder-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "cinder-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Acquiring lock "cinder-quobyte-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "cinder-quobyte-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:56 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 1073741824" returned: 0 in 1.131s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[631ed0e9-65f2-4d70-b4c1-d016e9dc5d9a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:56 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 Jul 11 17:58:56 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:57 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 Jul 11 17:58:57 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:57 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2" returned: 0 in 0.881s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:57 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b26ca7-b3b4-4968-912d-80a63dfcdea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b44c5d9-763e-4524-acad-ab0d7b589f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" returned: 0 in 0.995s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Volume volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 (9e638bbc-773c-4ea7-9167-d89077b2a6e2): created successfully Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b44c5d9-763e-4524-acad-ab0d7b589f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:58:57 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0 Jul 11 17:58:57 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (69b6c355-6eb7-4578-bdb1-d721fe870c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:58:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-54be7413-cef4-4a56-ac2d-ab4c95c6c301 tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-9e638bbc-773c-4ea7-9167-d89077b2a6e2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "cinder-9e638bbc-773c-4ea7-9167-d89077b2a6e2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-quobyte-9e638bbc-773c-4ea7-9167-d89077b2a6e2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-9e638bbc-773c-4ea7-9167-d89077b2a6e2" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:58:58 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bf70b-e0f3-43aa-994e-df703cafbc9a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "cinder-quobyte-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0" released by "delete_volume" :: held 1.805s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:58:58 devstack cinder-volume[86932]: WARNING cinder.quota [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1634966117 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1634966117, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:58:58 devstack cinder-volume[86932]: WARNING cinder.quota [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1634966117 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1634966117, it is now deprecated. Please use the default quota class for default quota. Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Created reservations ['e702a901-f4b7-41e8-ad5a-bb9577335e18', '322195d5-cc22-449e-b0a8-7c3ba80869b8', '73cf6fac-1bf6-4e40-b147-36289e7b63d6', '3e6e786c-a926-47a5-b67a-1bec2a390974'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:58:58 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 Jul 11 17:58:58 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:58:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:58:58 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:58:58 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:00 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2" returned: 0 in 1.509s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:00 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.311s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:00 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2 Jul 11 17:59:00 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Deleted volume successfully. Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3bdd721d-f455-4a39-bf66-741cf9e7a560 tempest-VolumeTypesAccessTest-268811239 None] Lock "cinder-2b5f9aef-1de0-45a4-9b0b-f8f1311993a0-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:00 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e638bbc-773c-4ea7-9167-d89077b2a6e2" returned: 0 in 0.848s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-9e638bbc-773c-4ea7-9167-d89077b2a6e2" released by "delete_volume" :: held 2.408s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Created reservations ['717fc0ef-14bd-4d47-98cc-362712528b77', '2610a0d1-c195-4212-8ace-60e0762f69f4', 'f4dbfd5b-776d-4291-8e68-dfb0949f1ad3', 'd1a65317-328b-47f3-8b2d-a03976eee4fd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:01 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:01 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:01 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Deleted volume successfully. Jul 11 17:59:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a5f765fa-ec8f-41cd-a2a6-58b73426ee3a tempest-VolumesActionsTest-1715292115 None] Lock "cinder-9e638bbc-773c-4ea7-9167-d89077b2a6e2-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (b29648e4-50df-479b-806f-16c79eef3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16089f1-4973-4183-a42c-cacf25063428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16089f1-4973-4183-a42c-cacf25063428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994663081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4306fcb-2ca5-41f7-972a-3e6384572c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:02Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfbcf19-31bd-4021-8760-efbdb116422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfbcf19-31bd-4021-8760-efbdb116422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0b7838-45a9-4668-a9f5-f1d7701579cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0b7838-45a9-4668-a9f5-f1d7701579cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4306fcb-2ca5-41f7-972a-3e6384572c0f', 'volume_name': 'volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e23634-1d34-483d-97fc-07323a632d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e23634-1d34-483d-97fc-07323a632d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b885daf-8c3a-4df3-90fe-c2d0f4a75b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:02 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Volume e4306fcb-2ca5-41f7-972a-3e6384572c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f', 'volume_size': 1} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994663081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4306fcb-2ca5-41f7-972a-3e6384572c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:02Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Creating volume e4306fcb-2ca5-41f7-972a-3e6384572c0f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:02 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:02 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f 1073741824 Jul 11 17:59:02 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:03 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f 1073741824" returned: 0 in 0.994s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:03 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f Jul 11 17:59:03 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:04 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f" returned: 0 in 0.699s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b885daf-8c3a-4df3-90fe-c2d0f4a75b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079720c8-4dda-47b1-a05d-af91b912a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Volume volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f (e4306fcb-2ca5-41f7-972a-3e6384572c0f): created successfully Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079720c8-4dda-47b1-a05d-af91b912a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (b29648e4-50df-479b-806f-16c79eef3274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f56f9f4f-6faf-4739-ac6e-0046d9dd47cf tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-e4306fcb-2ca5-41f7-972a-3e6384572c0f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-e4306fcb-2ca5-41f7-972a-3e6384572c0f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-quobyte-e4306fcb-2ca5-41f7-972a-3e6384572c0f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-e4306fcb-2ca5-41f7-972a-3e6384572c0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:05 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c229bd-9e69-4358-a340-78b960d15769]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:05 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f Jul 11 17:59:05 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:05 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f" returned: 0 in 0.904s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:05 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f Jul 11 17:59:05 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:06 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4306fcb-2ca5-41f7-972a-3e6384572c0f" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-e4306fcb-2ca5-41f7-972a-3e6384572c0f" released by "delete_volume" :: held 1.756s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Created reservations ['4ac91cc5-11e6-499d-b1f2-bfa6b79fb8a5', '9a255079-9b4c-4da7-a482-4c8ef3919437', 'e6e37033-997a-486b-922b-776a3ee910cc', '64f63160-468a-4a33-9c33-4efd67403a8f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:06 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:06 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (397027dc-b6c0-4f67-83b1-9079dd93b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e387e5d-c607-42c9-b62d-e6277e5085ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e387e5d-c607-42c9-b62d-e6277e5085ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975701320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9758939f-d6da-41a4-ae1e-3aa23e59d83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:08Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ee3c12-eb65-4911-a1c8-01b6a30cf8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ee3c12-eb65-4911-a1c8-01b6a30cf8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943f096-398e-43b0-9c41-8d87cdfbbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943f096-398e-43b0-9c41-8d87cdfbbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9758939f-d6da-41a4-ae1e-3aa23e59d83b', 'volume_name': 'volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c2f48-e8fe-41e6-965e-5664f5c4ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c2f48-e8fe-41e6-965e-5664f5c4ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077a2791-8ca8-492f-b1a5-921a95ecd891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Volume 9758939f-d6da-41a4-ae1e-3aa23e59d83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b', 'volume_size': 1} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975701320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9758939f-d6da-41a4-ae1e-3aa23e59d83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:08Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Creating volume 9758939f-d6da-41a4-ae1e-3aa23e59d83b {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:08 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:08 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b 1073741824 Jul 11 17:59:08 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:08 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.293s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Deleted volume successfully. Jul 11 17:59:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1bbc17-07a1-4b8b-895e-f2c69fc785f9 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-e4306fcb-2ca5-41f7-972a-3e6384572c0f-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:09 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b 1073741824" returned: 0 in 1.164s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:09 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b Jul 11 17:59:09 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:09 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077a2791-8ca8-492f-b1a5-921a95ecd891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a44fdb2-2cbc-4c0f-bd3f-2586ea56e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Volume volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b (9758939f-d6da-41a4-ae1e-3aa23e59d83b): created successfully Jul 11 17:59:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a44fdb2-2cbc-4c0f-bd3f-2586ea56e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (397027dc-b6c0-4f67-83b1-9079dd93b99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5370022f-7e97-461d-8268-5f121b53a1ae tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (e88e37f3-9234-4302-a05d-8510d0e373ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e2279-51a2-4972-96c0-6747a743dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-9758939f-d6da-41a4-ae1e-3aa23e59d83b-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e2279-51a2-4972-96c0-6747a743dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1740031796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620243e1-3829-42ab-8fc6-b62e685c70d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:11Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfb47b3-3627-4922-b6dd-e65136e55426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfb47b3-3627-4922-b6dd-e65136e55426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67fc3f9-ad7f-4e4f-a19c-754b66bf97b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67fc3f9-ad7f-4e4f-a19c-754b66bf97b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620243e1-3829-42ab-8fc6-b62e685c70d1', 'volume_name': 'volume-620243e1-3829-42ab-8fc6-b62e685c70d1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a770c-9bff-4fbb-b754-d848a35f5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a770c-9bff-4fbb-b754-d848a35f5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21dbb40-941c-4258-ae3e-881de4c6d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:11 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Volume 620243e1-3829-42ab-8fc6-b62e685c70d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620243e1-3829-42ab-8fc6-b62e685c70d1', 'volume_size': 1} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1740031796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620243e1-3829-42ab-8fc6-b62e685c70d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:11Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Creating volume 620243e1-3829-42ab-8fc6-b62e685c70d1 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:11 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-9758939f-d6da-41a4-ae1e-3aa23e59d83b-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:11 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 1073741824 Jul 11 17:59:11 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "cinder-quobyte-9758939f-d6da-41a4-ae1e-3aa23e59d83b" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-9758939f-d6da-41a4-ae1e-3aa23e59d83b" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e6bfd6-c6c7-4d4c-a794-29831bf8d92b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:11 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b Jul 11 17:59:11 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:12 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b" returned: 0 in 1.214s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:12 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b Jul 11 17:59:12 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:12 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 1073741824" returned: 0 in 1.375s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:13 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 Jul 11 17:59:13 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:13 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9758939f-d6da-41a4-ae1e-3aa23e59d83b" returned: 0 in 0.885s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-quobyte-9758939f-d6da-41a4-ae1e-3aa23e59d83b" released by "delete_volume" :: held 2.167s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:13 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1" returned: 0 in 0.855s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21dbb40-941c-4258-ae3e-881de4c6d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620243e1-3829-42ab-8fc6-b62e685c70d1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddb41f2-35cb-4916-9646-ace37c70811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Created reservations ['9d83018f-a8e0-4d60-b0e5-0bc9f820b815', '5f349afb-8316-4192-946d-3a67818ed083', '64f323e4-08f2-4917-8eba-25a952cadd19', '0723c297-c442-432a-bc69-da941bb80088'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:13 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Volume volume-620243e1-3829-42ab-8fc6-b62e685c70d1 (620243e1-3829-42ab-8fc6-b62e685c70d1): created successfully Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddb41f2-35cb-4916-9646-ace37c70811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (e88e37f3-9234-4302-a05d-8510d0e373ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-027c2e80-d31d-4937-887c-7dc865344408 tempest-AttachVolumeNegativeTest-1823960188 None] Created volume successfully. Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:14 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:14 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:14 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.716s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:14 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Deleted volume successfully. Jul 11 17:59:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fe97d23-b5d3-4b67-9c47-ed2a6eca1330 tempest-VolumesActionsTest-1715292115 None] Lock "cinder-9758939f-d6da-41a4-ae1e-3aa23e59d83b-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=105,cinder:SELECT=77,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (792944af-f3f6-4dc3-b92e-625facd2a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ee6fa-c9ff-4053-808b-df472fcaf047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ee6fa-c9ff-4053-808b-df472fcaf047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245780831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:15Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c382ae8-0b38-4cba-919c-8002cdb2f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c382ae8-0b38-4cba-919c-8002cdb2f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9e961a-2c78-402f-8db0-4ce105135552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9e961a-2c78-402f-8db0-4ce105135552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd', 'volume_name': 'volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b13b0f4-c27d-43a2-9448-37b84e4bbeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b13b0f4-c27d-43a2-9448-37b84e4bbeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912e95cc-c6db-4da5-8d95-59fff976ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:15 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Volume f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd', 'volume_size': 1} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245780831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3c733d1fdf4e94b84c3c24a803245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:15Z,use_quota=True,user_id='eb9428275ec34e5e89512a0a2054f099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Creating volume f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:15 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:15 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd 1073741824 Jul 11 17:59:15 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:16 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd 1073741824" returned: 0 in 0.937s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:16 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd Jul 11 17:59:16 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:17 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" returned: 0 in 0.709s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912e95cc-c6db-4da5-8d95-59fff976ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8686c2c2-3b8f-4cde-9cc0-5f8c137b567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Volume volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd (f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd): created successfully Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8686c2c2-3b8f-4cde-9cc0-5f8c137b567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Flow 'volume_create_manager' (792944af-f3f6-4dc3-b92e-625facd2a340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2d69d9ef-850a-4b5c-811e-cbecda6c5715 tempest-VolumesActionsTest-1228349118 None] Created volume successfully. Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (42f68b74-6ccf-4264-a40a-374e6f808a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badb9df0-a4c8-465c-bec1-8b21bf116b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badb9df0-a4c8-465c-bec1-8b21bf116b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902552289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9408fb10-2fe0-4d45-bee4-09b6311ad5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd8a599459f420a8b1f1746fc58367f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:17Z,use_quota=True,user_id='90fb24f112264c93908d34125c0fcae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e852d-6771-4f79-9929-2fd5dc7c14a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e852d-6771-4f79-9929-2fd5dc7c14a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82848da4-5879-423c-b3e6-af33291d00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82848da4-5879-423c-b3e6-af33291d00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9408fb10-2fe0-4d45-bee4-09b6311ad5b6', 'volume_name': 'volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94947fc-cf4d-4e94-8fb0-742334e2eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94947fc-cf4d-4e94-8fb0-742334e2eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a718994-32ff-45cf-b034-8b9edd3e158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6', 'volume_size': 1} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902552289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9408fb10-2fe0-4d45-bee4-09b6311ad5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd8a599459f420a8b1f1746fc58367f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:17Z,use_quota=True,user_id='90fb24f112264c93908d34125c0fcae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Creating volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:17 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:17 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 1073741824 Jul 11 17:59:17 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "cinder-quobyte-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-quobyte-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[60036dc6-2919-4f67-91fd-701734142bd7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:18 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd Jul 11 17:59:18 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:18 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 1073741824" returned: 0 in 0.994s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:18 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:18 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:19 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" returned: 0 in 0.809s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:19 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd Jul 11 17:59:19 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:19 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 0.714s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.469s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a718994-32ff-45cf-b034-8b9edd3e158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d0b8be-cf4c-4d59-8cb7-678b37902963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd476bb5-a9f5-4594-96fd-d46460c8977e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Volume volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 (9408fb10-2fe0-4d45-bee4-09b6311ad5b6): created successfully Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d0b8be-cf4c-4d59-8cb7-678b37902963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (42f68b74-6ccf-4264-a40a-374e6f808a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0709f1ce-5fcd-444d-9d2a-2a068fc6fd6d tempest-VolumesDeleteCascade-696525115 None] Created volume successfully. Jul 11 17:59:19 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 Jul 11 17:59:19 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:19 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" returned: 0 in 0.924s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-quobyte-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd" released by "delete_volume" :: held 1.785s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Created reservations ['b55c9838-ed0a-47c4-935f-e95d050059c7', '5b7a793c-14c5-4433-9bc5-6975a941c712', '6ca10344-78b1-4913-a2f5-f61f380061ce', '034c16e8-a432-405d-8656-1ab28dc9c10f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:20 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:20 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:20 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1" returned: 0 in 1.061s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.615s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Creating offline snapshot c48e8f1d-fba3-4386-aa67-45923a530673 of volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94565a4-0b4c-4751-8a21-2381c0dc0084]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-620243e1-3829-42ab-8fc6-b62e685c70d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54d7709a-63a2-4ba4-9e81-9c7ecb949455', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 17:59:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-8ffab3b2-6712-41df-99e1-737ecb90bdc3 req-51c6636f-0d94-4d4e-9643-3efc19e95a11 tempest-AttachVolumeNegativeTest-1823960188 None] attachment_update completed successfully. Jul 11 17:59:20 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:20 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:21 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.923s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:21 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Deleted volume successfully. Jul 11 17:59:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8b40ad0-8d46-474c-a1ed-b9d7f32fe5a4 tempest-VolumesActionsTest-1228349118 None] Lock "cinder-f7a75dc3-f660-48f2-a609-ff7d9e4fd4fd-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:21 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 0.998s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:21 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 1G Jul 11 17:59:21 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:22 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 1G" returned: 0 in 0.982s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:22 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:22 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:23 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:23 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 is being set with open permissions: ugo+rw Jul 11 17:59:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:23 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:23 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:24 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 0.881s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:24 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info Jul 11 17:59:24 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:24 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info" returned: 0 in 0.755s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:24 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info is being set with open permissions: ugo+rw Jul 11 17:59:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:24 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info Jul 11 17:59:24 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:25 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.info" returned: 0 in 1.019s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.590s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2fce0f2a-05be-4da8-b33a-d4535fac01a4 tempest-VolumesDeleteCascade-696525115 None] Create snapshot completed successfully Jul 11 17:59:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Creating offline snapshot c602176d-10f8-4aef-97cc-44fa760eebb5 of volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:59:26 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[063efa95-dec1-454a-9483-77d9848b2001]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:26 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:26 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:27 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 1.046s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:59:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:27 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 1G Jul 11 17:59:27 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:28 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 1G" returned: 0 in 1.245s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:28 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:28 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:30 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 1.359s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:30 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 is being set with open permissions: ugo+rw Jul 11 17:59:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:30 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:30 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:31 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 1.345s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.161s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f4851275-3f0d-4bd5-b392-6e7575496b26 tempest-VolumesDeleteCascade-696525115 None] Create snapshot completed successfully Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-9408fb10-2fe0-4d45-bee4-09b6311ad5b6-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-9408fb10-2fe0-4d45-bee4-09b6311ad5b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Performing cascade delete. {{(pid=86932) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-c48e8f1d-fba3-4386-aa67-45923a530673-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-c48e8f1d-fba3-4386-aa67-45923a530673-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-c48e8f1d-fba3-4386-aa67-45923a530673" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-c48e8f1d-fba3-4386-aa67-45923a530673" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Deleting offline snapshot c48e8f1d-fba3-4386-aa67-45923a530673 of volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] snapshot_file for this snap is: volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b6c86-e3a1-4e0b-80f0-9a3650288b31]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:32 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:32 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:33 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 1.103s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:59:33 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed570f2d-ebff-46cd-ad5a-fa7e054db06f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:33 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:33 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:34 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:34 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:34 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 1.060s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af79928-456b-44ae-bd2e-726dc02678b1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:34 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:34 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:34 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 8 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 17:59:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 17:59:35 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 1.053s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:59:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cea98-c83c-43f6-9d75-a204e30fe5a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:35 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:35 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Flow 'volume_create_manager' (a731feda-f2bd-44f5-b728-0f84e08eb909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7579e3-5554-41be-90e8-cf84cbed4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7579e3-5554-41be-90e8-cf84cbed4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-895964453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22902350-fd98-4ce7-af5e-383b53efca21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea66f8b4a5b4a46a1051644af35d522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:36Z,use_quota=True,user_id='dae58db081974cc5b2e4b95faf0ab66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590782a-d9f1-44e4-90a7-bf48085f2c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590782a-d9f1-44e4-90a7-bf48085f2c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f664f-e485-4c51-808a-1ae3d32c09ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:36 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 17:59:37 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f664f-e485-4c51-808a-1ae3d32c09ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22902350-fd98-4ce7-af5e-383b53efca21', 'volume_name': 'volume-22902350-fd98-4ce7-af5e-383b53efca21', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169b2710-059e-4116-ad5d-8c25c52e7703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169b2710-059e-4116-ad5d-8c25c52e7703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93236920-8979-4ceb-b4d9-f5d79649c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Volume 22902350-fd98-4ce7-af5e-383b53efca21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22902350-fd98-4ce7-af5e-383b53efca21', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Trying to clone 22902350-fd98-4ce7-af5e-383b53efca21 from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 1.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b6905-c3de-4fef-b84f-6a9ad8ef72ba]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:37 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:37 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:38 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 17:59:38 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Image download 20.69 MB at 20.69 MB/s Jul 11 17:59:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6003b-fe6d-4d00-84ae-8696290685ff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:38 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD Jul 11 17:59:38 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:38 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 1.460s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:38 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:38 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:39 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD" returned: 0 in 1.428s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:39 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 is fetched for user dae58db081974cc5b2e4b95faf0ab66b. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 17:59:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b1db1b-855a-48fd-8ac2-dd06dc225064]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:40 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD Jul 11 17:59:40 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:40 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 1.974s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:40 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673 Jul 11 17:59:40 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:41 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD" returned: 0 in 1.607s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-895964453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22902350-fd98-4ce7-af5e-383b53efca21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea66f8b4a5b4a46a1051644af35d522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:36Z,use_quota=True,user_id='dae58db081974cc5b2e4b95faf0ab66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Creating volume 22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:41 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:41 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1073741824 Jul 11 17:59:41 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:41 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c48e8f1d-fba3-4386-aa67-45923a530673" returned: 0 in 1.067s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 -F qcow2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:41 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 -F qcow2 Jul 11 17:59:41 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:42 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 -F qcow2" returned: 0 in 0.811s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-c48e8f1d-fba3-4386-aa67-45923a530673" released by "_delete_snapshot" :: held 10.553s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" released by "delete_snapshot" :: held 10.598s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:42 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1073741824" returned: 0 in 1.048s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Created reservations ['98bc48d2-0629-420e-b724-3d36a3e45543', '9b886559-24bb-4d86-b9cc-a5fa58c70606', 'fb593be2-daad-4f04-9dad-19c81f234f94', 'ac0c754e-b8a5-48e3-be40-92c519b5f24b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:42 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:42 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Delete snapshot completed successfully. Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-c48e8f1d-fba3-4386-aa67-45923a530673-delete_snapshot" released by "delete_snapshot" :: held 10.828s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-c602176d-10f8-4aef-97cc-44fa760eebb5-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-c602176d-10f8-4aef-97cc-44fa760eebb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-c602176d-10f8-4aef-97cc-44fa760eebb5" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-c602176d-10f8-4aef-97cc-44fa760eebb5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Deleting offline snapshot c602176d-10f8-4aef-97cc-44fa760eebb5 of volume 9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] snapshot_file for this snap is: volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8080d453-ad6e-4d6c-8c54-aa37ebc55798]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:43 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:43 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:43 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 0 in 0.750s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Attempting download of 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume 22902350-fd98-4ce7-af5e-383b53efca21. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d9391a-403e-4e21-b495-d841b06ae4b3]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:43 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g Jul 11 17:59:43 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:43 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 0.919s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d1e5a-a48e-4e88-b1ba-12a3ddd02f89]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:44 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:44 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:44 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g" returned: 0 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:44 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g Jul 11 17:59:44 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:44 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 0.908s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:44 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:44 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:45 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g" returned: 1 in 1.116s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_3scwfi0g' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d30b92-7828-459a-acb9-f2fbe7dea284]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:45 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD Jul 11 17:59:45 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:45 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 1.090s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:45 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5 Jul 11 17:59:45 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:46 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD" returned: 0 in 1.038s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:46 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 was qcow2, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 17:59:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:46 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:46 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:46 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6.c602176d-10f8-4aef-97cc-44fa760eebb5" returned: 0 in 1.033s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-c602176d-10f8-4aef-97cc-44fa760eebb5" released by "_delete_snapshot" :: held 4.109s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" released by "delete_snapshot" :: held 4.164s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=96,cinder:SELECT=64,cinder:DELETE=8,cinder:INSERT=20 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Created reservations ['c0f4e4bc-0eb7-4352-8b4d-f994031a67c9', '30dc47db-2e7f-4e61-9aae-64c3b30b5447', 'cf2863f8-b988-4540-aeae-eee923503071', '3a7edb4f-571c-4410-8b1c-8c0dd29cc778'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Delete snapshot completed successfully. Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-c602176d-10f8-4aef-97cc-44fa760eebb5-delete_snapshot" released by "delete_snapshot" :: held 4.397s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Snapshots deleted, issuing volume delete {{(pid=86932) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef1589-c412-4769-97b3-011276cef9d8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:47 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:47 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:48 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 1.511s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:48 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6 Jul 11 17:59:48 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:49 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 0 in 3.258s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:49 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_sdcd89zldevstack@QuobyteHD, size 112.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 17:59:49 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Converted 112.00 MB image at 34.30 MB/s Jul 11 17:59:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:49 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1G Jul 11 17:59:49 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:50 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" returned: 0 in 1.563s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-9408fb10-2fe0-4d45-bee4-09b6311ad5b6" released by "delete_volume" :: held 3.198s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Created reservations ['b2139ff1-1a31-46a0-aa71-95e80e567f2b', '2a1ecd55-17b2-4595-902d-5ddbae5fd090', '8f34d047-d25d-4030-a0ad-80cfcf314b64', '71dd3847-d991-4889-937e-5343838a1699'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:50 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 17:59:50 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:51 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.935s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:51 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 17:59:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Deleted volume successfully. Jul 11 17:59:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87dee33d-52bb-41b9-a5a0-ecca4a64dfbb tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-9408fb10-2fe0-4d45-bee4-09b6311ad5b6-delete_volume" released by "delete_volume" :: held 19.853s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:51 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 1G" returned: 0 in 2.113s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d222e-4ff2-4469-8987-a3c519779956]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:52 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:52 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (a694cb67-16b6-4ea0-9e07-28be81a01881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf40672-8c2a-43be-be04-e23ed6cd0887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf40672-8c2a-43be-be04-e23ed6cd0887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949585171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39817b67-838d-4454-b203-9299eabaa1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd8a599459f420a8b1f1746fc58367f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:53Z,use_quota=True,user_id='90fb24f112264c93908d34125c0fcae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f827eb-9403-40c9-8478-2202a663e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f827eb-9403-40c9-8478-2202a663e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647b9c83-8a1d-453d-9d9a-c2c635cd433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647b9c83-8a1d-453d-9d9a-c2c635cd433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39817b67-838d-4454-b203-9299eabaa1ff', 'volume_name': 'volume-39817b67-838d-4454-b203-9299eabaa1ff', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65a5f12-84ec-4f6e-9812-46ee5c63f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65a5f12-84ec-4f6e-9812-46ee5c63f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b695ad1a-c69b-4161-acc5-da5da6e1e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Volume 39817b67-838d-4454-b203-9299eabaa1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39817b67-838d-4454-b203-9299eabaa1ff', 'volume_size': 1} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T15:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949585171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39817b67-838d-4454-b203-9299eabaa1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd8a599459f420a8b1f1746fc58367f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T15:59:53Z,use_quota=True,user_id='90fb24f112264c93908d34125c0fcae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Creating volume 39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 17:59:53 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:53 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff 1073741824 Jul 11 17:59:53 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:53 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 0 in 1.528s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:53 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:53 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:54 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff 1073741824" returned: 0 in 1.265s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:54 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 17:59:54 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:55 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 1 in 1.561s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Downloaded image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume 22902350-fd98-4ce7-af5e-383b53efca21 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 for user dae58db081974cc5b2e4b95faf0ab66b is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Marking volume 22902350-fd98-4ce7-af5e-383b53efca21 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Copying metadata from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 to 22902350-fd98-4ce7-af5e-383b53efca21. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Creating volume glance metadata for volume 22902350-fd98-4ce7-af5e-383b53efca21 backed by image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93236920-8979-4ceb-b4d9-f5d79649c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22902350-fd98-4ce7-af5e-383b53efca21', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61856dd-3af9-47fd-9c42-bd344ccddcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Volume volume-22902350-fd98-4ce7-af5e-383b53efca21 (22902350-fd98-4ce7-af5e-383b53efca21): created successfully Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61856dd-3af9-47fd-9c42-bd344ccddcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Flow 'volume_create_manager' (a731feda-f2bd-44f5-b728-0f84e08eb909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-845923fb-5559-4bf1-98a7-677cf9288974 tempest-VolumesImageMetadata-1236401678 None] Created volume successfully. Jul 11 17:59:55 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 1.037s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b695ad1a-c69b-4161-acc5-da5da6e1e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39817b67-838d-4454-b203-9299eabaa1ff', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405ea343-f0f3-434a-a507-31080ce98878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 17:59:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Volume volume-39817b67-838d-4454-b203-9299eabaa1ff (39817b67-838d-4454-b203-9299eabaa1ff): created successfully Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405ea343-f0f3-434a-a507-31080ce98878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 17:59:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (a694cb67-16b6-4ea0-9e07-28be81a01881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 17:59:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7611ada3-1601-47f0-a2b0-15b100009110 tempest-VolumesDeleteCascade-696525115 None] Created volume successfully. Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Creating offline snapshot e6b29581-64dc-4d26-b188-8f1d77631f4b of volume 39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ec13b-8620-4a4d-8b38-ec9752be1372]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:56 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 17:59:56 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Acquiring lock "cinder-22902350-fd98-4ce7-af5e-383b53efca21-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "cinder-22902350-fd98-4ce7-af5e-383b53efca21-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Acquiring lock "cinder-quobyte-22902350-fd98-4ce7-af5e-383b53efca21" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "cinder-quobyte-22902350-fd98-4ce7-af5e-383b53efca21" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbf52c5-dd86-4001-9724-753be7f8f21b]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:57 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:57 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:57 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 0.972s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:57 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b 1G Jul 11 17:59:57 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:58 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 0 in 0.879s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:58 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:58 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:58 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b 1G" returned: 0 in 0.925s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39817b67-838d-4454-b203-9299eabaa1ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:58 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39817b67-838d-4454-b203-9299eabaa1ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 17:59:58 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:58 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 1 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 17:59:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:58 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21 Jul 11 17:59:58 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:59 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39817b67-838d-4454-b203-9299eabaa1ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:59 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b is being set with open permissions: ugo+rw Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:59 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 17:59:59 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:59 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-22902350-fd98-4ce7-af5e-383b53efca21" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "cinder-quobyte-22902350-fd98-4ce7-af5e-383b53efca21" released by "delete_volume" :: held 2.617s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Created reservations ['be194e1c-398c-4069-8f5e-07adf8b3c6cf', '35872d16-7c1b-474b-bd79-81af2e521eb6', '5bac5b2f-82d4-4910-ba22-005a9f5fc98b', 'e9a22136-4495-49f6-8139-f59d17148f02'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 17:59:59 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 0.772s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 17:59:59 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info Jul 11 17:59:59 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 17:59:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:00 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:00 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Flow 'volume_create_manager' (08391c0b-49f7-4f0f-b304-d8e242f777f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5b4d8a-2643-41a9-a8d8-993c8650f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5b4d8a-2643-41a9-a8d8-993c8650f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-242353315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28c311f-9d90-4c6a-b769-3ebaeffab3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee56cdd434a34f7db7aa88b56be52594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:01Z,use_quota=True,user_id='b0600b9252244955a6761da581128c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44dbbab-9131-499e-a1f8-895fc55af212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44dbbab-9131-499e-a1f8-895fc55af212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcccd243-8496-4443-b255-ef25aa2de818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcccd243-8496-4443-b255-ef25aa2de818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28c311f-9d90-4c6a-b769-3ebaeffab3ba', 'volume_name': 'volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f827468b-04f6-4d01-9bd0-86d0599db18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f827468b-04f6-4d01-9bd0-86d0599db18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:00 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70148ad3-a977-4d1c-bc4f-a726b7ef9a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:00 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Volume a28c311f-9d90-4c6a-b769-3ebaeffab3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba', 'volume_size': 1} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info" returned: 0 in 0.980s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:00 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info is being set with open permissions: ugo+rw Jul 11 18:00:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:00 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info Jul 11 18:00:00 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:01 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.183s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Deleted volume successfully. Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cabc76b6-03c0-4e61-a987-cb02df145066 tempest-VolumesImageMetadata-1236401678 None] Lock "cinder-22902350-fd98-4ce7-af5e-383b53efca21-delete_volume" released by "delete_volume" :: held 4.214s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:01 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.info" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.356s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-242353315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28c311f-9d90-4c6a-b769-3ebaeffab3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee56cdd434a34f7db7aa88b56be52594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:01Z,use_quota=True,user_id='b0600b9252244955a6761da581128c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Creating volume a28c311f-9d90-4c6a-b769-3ebaeffab3ba {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:01 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:01 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba 1073741824 Jul 11 18:00:01 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2e6e350b-a9fd-4ed0-9d81-bcfe50bbb866 tempest-VolumesDeleteCascade-696525115 None] Create snapshot completed successfully Jul 11 18:00:02 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba 1073741824" returned: 0 in 0.856s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:02 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba Jul 11 18:00:02 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:03 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" returned: 0 in 0.750s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70148ad3-a977-4d1c-bc4f-a726b7ef9a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8f9c5-99d9-4444-beba-29a1d7e56cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (03fe2275-fcd0-4e0a-ae31-5a0eb7c6c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d938aad9-82cf-4785-9976-db853ea63441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Volume volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba (a28c311f-9d90-4c6a-b769-3ebaeffab3ba): created successfully Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8f9c5-99d9-4444-beba-29a1d7e56cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Flow 'volume_create_manager' (08391c0b-49f7-4f0f-b304-d8e242f777f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d938aad9-82cf-4785-9976-db853ea63441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1992759518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88df9f6-902b-48d7-a869-844b15ffa87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd8a599459f420a8b1f1746fc58367f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6b29581-64dc-4d26-b188-8f1d77631f4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:03Z,use_quota=True,user_id='90fb24f112264c93908d34125c0fcae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53993330-0d17-421c-903f-c7b53c1c8c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53993330-0d17-421c-903f-c7b53c1c8c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbef8ac-4c2c-4098-865d-dcbeff3a607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbef8ac-4c2c-4098-865d-dcbeff3a607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd88df9f6-902b-48d7-a869-844b15ffa87c', 'volume_name': 'volume-d88df9f6-902b-48d7-a869-844b15ffa87c', 'volume_size': 1, 'snapshot_id': 'e6b29581-64dc-4d26-b188-8f1d77631f4b'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddb9cda-4d58-4e1a-96eb-9617cc842bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddb9cda-4d58-4e1a-96eb-9617cc842bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deed91ea-6530-49cd-8736-ed3bff70fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Volume d88df9f6-902b-48d7-a869-844b15ffa87c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d88df9f6-902b-48d7-a869-844b15ffa87c', 'volume_size': 1, 'snapshot_id': 'e6b29581-64dc-4d26-b188-8f1d77631f4b'} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b-d88df9f6-902b-48d7-a869-844b15ffa87c" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2639cb49-12f1-4d38-a805-5dff4bdc1eaa tempest-ServersNegativeTestJSON-602177072 None] Created volume successfully. Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b-d88df9f6-902b-48d7-a869-844b15ffa87c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Creating volume d88df9f6-902b-48d7-a869-844b15ffa87c from snapshot e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] snapshot: e6b29581-64dc-4d26-b188-8f1d77631f4b, volume: d88df9f6-902b-48d7-a869-844b15ffa87c, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d7fda3-282b-4939-b31b-83b125fa05dc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:03 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 18:00:03 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:04 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 0.823s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39817b67-838d-4454-b203-9299eabaa1ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d45a0-f3e8-459c-b23a-a343dfbc47ff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:04 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 18:00:04 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Flow 'volume_create_manager' (65075fbc-343a-4af9-b65a-4586f7d87868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e828508-fc4e-45b8-8711-bba5b73abf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e828508-fc4e-45b8-8711-bba5b73abf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1127870967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1ba5c-0734-4d5d-a145-6ef9bab0f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee56cdd434a34f7db7aa88b56be52594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:05Z,use_quota=True,user_id='b0600b9252244955a6761da581128c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79af5de6-c282-4d8c-b156-8cf555109e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79af5de6-c282-4d8c-b156-8cf555109e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8093d543-e0f0-4981-b4bb-5f78aee6da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8093d543-e0f0-4981-b4bb-5f78aee6da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd1ba5c-0734-4d5d-a145-6ef9bab0f666', 'volume_name': 'volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dbae35-7c16-4283-b169-c0cc084ad89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dbae35-7c16-4283-b169-c0cc084ad89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0267b42-70e5-45e1-806e-a5e412e239d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:05 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Volume 3dd1ba5c-0734-4d5d-a145-6ef9bab0f666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666', 'volume_size': 1} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:05 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 0.876s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:00:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:05 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c Jul 11 18:00:05 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Flow 'volume_create_manager' (5b6e1813-c611-4012-ba5e-5a43fec027c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8bf096-ef3f-4f39-b78c-72d80a9cf74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8bf096-ef3f-4f39-b78c-72d80a9cf74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-667407032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34568fdf-950e-446e-b6d1-4e97fbf315b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678ec3ce25cc446596e54f2c6240ec17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:08Z,use_quota=True,user_id='efa6a8cd3ff94eafa1a4d698266d17ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749b29da-23fa-4408-abbe-192f81219b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749b29da-23fa-4408-abbe-192f81219b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d8a33-93f6-4c57-a13f-58f12b8e25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d8a33-93f6-4c57-a13f-58f12b8e25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34568fdf-950e-446e-b6d1-4e97fbf315b7', 'volume_name': 'volume-34568fdf-950e-446e-b6d1-4e97fbf315b7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cf9c74-19e3-48b9-bdcd-894acf52b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cf9c74-19e3-48b9-bdcd-894acf52b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22a9fee-590d-4837-ba36-c9cad76db50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Volume 34568fdf-950e-446e-b6d1-4e97fbf315b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34568fdf-950e-446e-b6d1-4e97fbf315b7', 'volume_size': 1} Jul 11 18:00:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:10 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c" returned: 0 in 5.538s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb7b37-5d59-4434-a983-85a7c309adfa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:11 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 18:00:11 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:11 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 1.013s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:11 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:00:11 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Converted 1024.00 MB image at 184.86 MB/s Jul 11 18:00:11 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c is being set with open permissions: ugo+rw Jul 11 18:00:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:11 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c Jul 11 18:00:11 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:12 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c" returned: 0 in 0.647s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" released by "_copy_volume_from_snapshot" :: held 9.007s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b-d88df9f6-902b-48d7-a869-844b15ffa87c" released by "_create_volume_from_snapshot" :: held 9.040s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.058s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1127870967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1ba5c-0734-4d5d-a145-6ef9bab0f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee56cdd434a34f7db7aa88b56be52594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:05Z,use_quota=True,user_id='b0600b9252244955a6761da581128c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Creating volume 3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:12 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:12 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 1073741824 Jul 11 18:00:12 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deed91ea-6530-49cd-8736-ed3bff70fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88df9f6-902b-48d7-a869-844b15ffa87c', 'volume_size': 1, 'snapshot_id': 'e6b29581-64dc-4d26-b188-8f1d77631f4b'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed9b6b4-33e5-4c28-bb84-74edcac7cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Volume volume-d88df9f6-902b-48d7-a869-844b15ffa87c (d88df9f6-902b-48d7-a869-844b15ffa87c): created successfully Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed9b6b4-33e5-4c28-bb84-74edcac7cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Flow 'volume_create_manager' (03fe2275-fcd0-4e0a-ae31-5a0eb7c6c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d23bd6cc-d830-4a3c-9944-574490618fdd tempest-VolumesDeleteCascade-696525115 None] Created volume successfully. Jul 11 18:00:13 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 1073741824" returned: 0 in 0.944s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-39817b67-838d-4454-b203-9299eabaa1ff-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-39817b67-838d-4454-b203-9299eabaa1ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:13 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 Jul 11 18:00:13 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Performing cascade delete. {{(pid=86932) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-e6b29581-64dc-4d26-b188-8f1d77631f4b-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-e6b29581-64dc-4d26-b188-8f1d77631f4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Deleting offline snapshot e6b29581-64dc-4d26-b188-8f1d77631f4b of volume 39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] snapshot_file for this snap is: volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e9e5e-83ed-46a0-a490-97533e242bae]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:13 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 18:00:13 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:14 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" returned: 0 in 0.688s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.218s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-667407032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34568fdf-950e-446e-b6d1-4e97fbf315b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678ec3ce25cc446596e54f2c6240ec17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:08Z,use_quota=True,user_id='efa6a8cd3ff94eafa1a4d698266d17ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Creating volume 34568fdf-950e-446e-b6d1-4e97fbf315b7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0267b42-70e5-45e1-806e-a5e412e239d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:14 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 1073741824 Jul 11 18:00:14 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7433c4-8799-4760-9d6e-d2a7041221e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Volume volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 (3dd1ba5c-0734-4d5d-a145-6ef9bab0f666): created successfully Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7433c4-8799-4760-9d6e-d2a7041221e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Flow 'volume_create_manager' (65075fbc-343a-4af9-b65a-4586f7d87868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f898958a-367a-4071-b2fe-fe5c90e8b4ac tempest-ServersNegativeTestJSON-602177072 None] Created volume successfully. Jul 11 18:00:14 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39817b67-838d-4454-b203-9299eabaa1ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a02fb-dc89-4e2b-b93a-fa6b2539988e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:14 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 18:00:14 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:15 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 1073741824" returned: 0 in 1.099s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:15 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 Jul 11 18:00:15 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:15 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 0.984s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:15 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 18:00:15 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "cinder-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=68,cinder:INSERT=21,cinder:UPDATE=62,cinder:DELETE=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "cinder-quobyte-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-quobyte-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[381dda22-066b-4f69-af2d-aba775deb24e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:16 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 Jul 11 18:00:16 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:16 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7" returned: 0 in 1.042s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22a9fee-590d-4837-ba36-c9cad76db50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34568fdf-950e-446e-b6d1-4e97fbf315b7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b645386-2569-4d4d-9021-0b22a9a226cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Volume volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 (34568fdf-950e-446e-b6d1-4e97fbf315b7): created successfully Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b645386-2569-4d4d-9021-0b22a9a226cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Flow 'volume_create_manager' (5b6e1813-c611-4012-ba5e-5a43fec027c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-71273509-2244-4ba3-93dd-95fc03d2c43c tempest-AbsoluteLimitsTests-88593837 None] Created volume successfully. Jul 11 18:00:16 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 1.007s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:16 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b Jul 11 18:00:16 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Acquiring lock "cinder-34568fdf-950e-446e-b6d1-4e97fbf315b7-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "cinder-34568fdf-950e-446e-b6d1-4e97fbf315b7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Acquiring lock "cinder-quobyte-34568fdf-950e-446e-b6d1-4e97fbf315b7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "cinder-quobyte-34568fdf-950e-446e-b6d1-4e97fbf315b7" acquired by "delete_volume" :: waited 0.051s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a236fa6-14f3-49fe-a202-efcca53da345]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:17 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 Jul 11 18:00:17 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:17 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" returned: 0 in 1.111s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:17 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666 Jul 11 18:00:17 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:17 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff.e6b29581-64dc-4d26-b188-8f1d77631f4b" returned: 0 in 0.798s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-e6b29581-64dc-4d26-b188-8f1d77631f4b" released by "_delete_snapshot" :: held 3.730s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" released by "delete_snapshot" :: held 3.755s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Created reservations ['08ed2829-9ea1-4f60-87d3-0c416fa9203a', 'b3e39889-52a7-4469-93cc-be5703e11abf', '14c1eb02-aceb-48ae-90d0-1b997bfed6f3', '079b7b52-1964-4d05-ad58-711fa2cbec24'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Delete snapshot completed successfully. Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-e6b29581-64dc-4d26-b188-8f1d77631f4b-delete_snapshot" released by "delete_snapshot" :: held 3.949s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Snapshots deleted, issuing volume delete {{(pid=86932) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9853206a-b830-4086-b1b2-bca9e2c5d5d1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:17 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 18:00:17 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:18 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7" returned: 0 in 0.915s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:18 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:18 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7 Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" returned: 0 in 0.746s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:18 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-quobyte-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666" released by "delete_volume" :: held 1.925s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Created reservations ['f0df9177-857e-4c57-9edd-169964f95b07', '78dba2bd-8a83-43dd-9ed0-35e49fd74510', '0bcf3c10-d350-4b0e-86fe-0aafe9fdc668', '378822a7-d81f-430e-8cac-448b1adeec78'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "cinder-a28c311f-9d90-4c6a-b769-3ebaeffab3ba-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:18 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:18 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-a28c311f-9d90-4c6a-b769-3ebaeffab3ba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "cinder-quobyte-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-quobyte-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69921c9-eec1-4903-be55-2095489ea461]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:18 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba Jul 11 18:00:18 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:18 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 0.944s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:18 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff Jul 11 18:00:18 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:18 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-34568fdf-950e-446e-b6d1-4e97fbf315b7" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "cinder-quobyte-34568fdf-950e-446e-b6d1-4e97fbf315b7" released by "delete_volume" :: held 1.793s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Created reservations ['7bb1e542-c478-48a9-9b30-1904be73cf86', 'a399cbda-7c13-4fc7-8ef4-d00ef17325f7', 'ddab316a-da3e-4b9f-aa3a-ee5da13c68af', '8d76de3a-ff1b-49f9-8805-76fb591f3a07'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:19 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Deleted volume successfully. Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7364765d-312f-40f8-b387-4e2f5a1d68f0 tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-3dd1ba5c-0734-4d5d-a145-6ef9bab0f666-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:19 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:19 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:19 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" returned: 0 in 0.989s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:19 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba Jul 11 18:00:19 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:19 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-39817b67-838d-4454-b203-9299eabaa1ff" returned: 0 in 0.980s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-39817b67-838d-4454-b203-9299eabaa1ff" released by "delete_volume" :: held 1.998s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Created reservations ['f24a33c9-598a-41c8-90f7-7054c32d1e49', '9a8ab064-5d8d-4c52-8f88-c52394ef2746', '90922035-d873-4031-8d12-6e38854a2e52', 'aaea3a57-06df-4045-99a9-d6c31574cbb4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:19 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:19 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:19 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.753s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Deleted volume successfully. Jul 11 18:00:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8e6fadfa-4b5e-48ad-b245-8a92e32b163b tempest-AbsoluteLimitsTests-88593837 None] Lock "cinder-34568fdf-950e-446e-b6d1-4e97fbf315b7-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:20 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" returned: 0 in 0.866s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-quobyte-a28c311f-9d90-4c6a-b769-3ebaeffab3ba" released by "delete_volume" :: held 1.918s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-d88df9f6-902b-48d7-a869-844b15ffa87c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Created reservations ['82e42de9-b4cc-488f-a3cc-f2f6be52c952', 'c84c86e9-3d27-4a24-b596-c1c9148fd3bb', '7c8a794b-b1a8-45db-855f-4b1ae6696820', 'ec19d59e-368f-47f6-9bf7-8dc49c7f2552'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-d88df9f6-902b-48d7-a869-844b15ffa87c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[775da1ec-e739-44c2-afa2-2c89111dcb0e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:20 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:20 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:20 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.915s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Deleted volume successfully. Jul 11 18:00:20 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c Jul 11 18:00:20 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-237a0c3f-3126-4d71-8994-8376c19db4b5 tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-39817b67-838d-4454-b203-9299eabaa1ff-delete_volume" released by "delete_volume" :: held 7.198s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:21 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.900s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:21 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Deleted volume successfully. Jul 11 18:00:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-758514a4-ac07-46d4-bb15-36b1aa0861fb tempest-ServersNegativeTestJSON-602177072 None] Lock "cinder-a28c311f-9d90-4c6a-b769-3ebaeffab3ba-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:21 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c" returned: 0 in 1.139s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:21 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c Jul 11 18:00:21 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:22 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d88df9f6-902b-48d7-a869-844b15ffa87c" returned: 0 in 0.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-quobyte-d88df9f6-902b-48d7-a869-844b15ffa87c" released by "delete_volume" :: held 1.973s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Created reservations ['b2960e0b-97da-4652-b89c-b360ae517600', '4e834e4a-37d0-4cbe-9c64-89d9ee5d555f', '2aa6d9d6-4bd5-4862-81d4-25dd6b92b7ba', '603f5727-594f-477c-98e6-677b435c6869'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:22 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:22 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:23 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.079s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:23 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Deleted volume successfully. Jul 11 18:00:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bb12475c-5c34-4123-b9a6-3b719eac266d tempest-VolumesDeleteCascade-696525115 None] Lock "cinder-d88df9f6-902b-48d7-a869-844b15ffa87c-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-5472452e-085b-4c44-abc0-78d020a311c3 req-8838dd28-d54a-4547-88bf-f91f77e4b6b3 tempest-AttachVolumeNegativeTest-1823960188 None] Terminate volume connection completed successfully. Jul 11 18:00:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-5472452e-085b-4c44-abc0-78d020a311c3 req-8838dd28-d54a-4547-88bf-f91f77e4b6b3 tempest-AttachVolumeNegativeTest-1823960188 None] Deleting attachment 54d7709a-63a2-4ba4-9e81-9c7ecb949455. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Flow 'volume_create_manager' (952f6116-2dfa-4ccc-9e91-23aef8ce8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec36e4b0-d006-4ae5-a417-59d5020b000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec36e4b0-d006-4ae5-a417-59d5020b000e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2028978426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d5fb20-da4b-4596-83a7-069698bd82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654fb8af5c654b5ba9a03c2d2cf074b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:29Z,use_quota=True,user_id='16ff9e92985149dcb069e98bfa923ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090882e6-8a03-4bc1-93d1-198c2ddab5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090882e6-8a03-4bc1-93d1-198c2ddab5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00d844-d0aa-4591-9928-e7f1ee8129d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00d844-d0aa-4591-9928-e7f1ee8129d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d5fb20-da4b-4596-83a7-069698bd82b4', 'volume_name': 'volume-95d5fb20-da4b-4596-83a7-069698bd82b4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92241178-a35d-4a96-bd74-7101531631b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92241178-a35d-4a96-bd74-7101531631b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f3f696-5cee-4eb8-82ed-4c28fd1735aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:28 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Volume 95d5fb20-da4b-4596-83a7-069698bd82b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d5fb20-da4b-4596-83a7-069698bd82b4', 'volume_size': 1} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2028978426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d5fb20-da4b-4596-83a7-069698bd82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654fb8af5c654b5ba9a03c2d2cf074b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:29Z,use_quota=True,user_id='16ff9e92985149dcb069e98bfa923ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Creating volume 95d5fb20-da4b-4596-83a7-069698bd82b4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:28 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:28 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 1073741824 Jul 11 18:00:28 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:29 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 1073741824" returned: 0 in 0.977s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:29 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 Jul 11 18:00:29 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:30 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4" returned: 0 in 0.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f3f696-5cee-4eb8-82ed-4c28fd1735aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d5fb20-da4b-4596-83a7-069698bd82b4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ccaa25-5a22-4e81-bb00-1e8d560aa6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Volume volume-95d5fb20-da4b-4596-83a7-069698bd82b4 (95d5fb20-da4b-4596-83a7-069698bd82b4): created successfully Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ccaa25-5a22-4e81-bb00-1e8d560aa6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Flow 'volume_create_manager' (952f6116-2dfa-4ccc-9e91-23aef8ce8e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4d6b9886-82da-4f18-b6aa-61c6a61c0b00 tempest-VolumesTransfersV355Test-1336579233 None] Created volume successfully. Jul 11 18:00:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-cec1f4c7-8335-4990-bdf6-6aebf2b3a84e tempest-VolumesTransfersV355Test-871560692 None] Transfer volume completed successfully. Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "cinder-95d5fb20-da4b-4596-83a7-069698bd82b4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-95d5fb20-da4b-4596-83a7-069698bd82b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "cinder-quobyte-95d5fb20-da4b-4596-83a7-069698bd82b4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-quobyte-95d5fb20-da4b-4596-83a7-069698bd82b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[880a3b74-9842-4ccc-a6a4-6a1c62a57467]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:34 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 Jul 11 18:00:34 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:34 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:34 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:35 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4" returned: 0 in 1.111s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:35 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4 Jul 11 18:00:35 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:35 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.034s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:00:35 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-95d5fb20-da4b-4596-83a7-069698bd82b4" returned: 0 in 0.801s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-quobyte-95d5fb20-da4b-4596-83a7-069698bd82b4" released by "delete_volume" :: held 1.980s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:35 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Created reservations ['b3326c98-a49a-48a6-827f-d431ed07dd63', '588baa43-1d20-47a7-8b70-22710e520c28', '8c221a31-361a-493a-a2a8-96df43e45f0d', 'fb96d20a-5364-445d-b471-e5575ac08352'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:36 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:36 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:37 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Flow 'volume_create_manager' (45aca1f9-27de-431c-bdfd-ef2e64617f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea573be7-2942-4d15-ad29-f33f7420b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.999s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea573be7-2942-4d15-ad29-f33f7420b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1449348197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d338714-374f-454e-bb96-afb7f7245ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654fb8af5c654b5ba9a03c2d2cf074b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:37Z,use_quota=True,user_id='16ff9e92985149dcb069e98bfa923ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6548b10c-262e-4f88-88f3-8f07ae2af6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6548b10c-262e-4f88-88f3-8f07ae2af6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dabb21b-9145-438d-8b0c-8e25c9e6cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dabb21b-9145-438d-8b0c-8e25c9e6cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d338714-374f-454e-bb96-afb7f7245ef5', 'volume_name': 'volume-2d338714-374f-454e-bb96-afb7f7245ef5', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2837ff-d5c6-4e16-b4db-9afaf11f713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2837ff-d5c6-4e16-b4db-9afaf11f713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e7881-e919-4df8-838a-03b07815a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Volume 2d338714-374f-454e-bb96-afb7f7245ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d338714-374f-454e-bb96-afb7f7245ef5', 'volume_size': 1} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1449348197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d338714-374f-454e-bb96-afb7f7245ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654fb8af5c654b5ba9a03c2d2cf074b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:37Z,use_quota=True,user_id='16ff9e92985149dcb069e98bfa923ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Creating volume 2d338714-374f-454e-bb96-afb7f7245ef5 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:37 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Deleted volume successfully. Jul 11 18:00:37 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 1073741824 Jul 11 18:00:37 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d09cd30-a40b-430e-8ed3-50a94cfa891b tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-95d5fb20-da4b-4596-83a7-069698bd82b4-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Flow 'volume_create_manager' (42710ac4-2ac2-47ff-b8cc-24fab017057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878c5199-14fd-42f3-be79-254841650f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878c5199-14fd-42f3-be79-254841650f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484228239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb638a5-e804-4f6f-8f27-9441a84a7f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd6c78875454c7596df41374dd9f56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:38Z,use_quota=True,user_id='0f20169c65aa4e9a94ad583a8de45de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45408ec4-5da2-41f5-be50-e33410c6ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45408ec4-5da2-41f5-be50-e33410c6ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f510fce6-4fc7-4c70-a0bc-8b3fdef58bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f510fce6-4fc7-4c70-a0bc-8b3fdef58bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb638a5-e804-4f6f-8f27-9441a84a7f05', 'volume_name': 'volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021d94fb-254d-4fd9-8a49-b265caa2d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021d94fb-254d-4fd9-8a49-b265caa2d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39482865-66f0-46e0-8af9-513e9f334033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:38 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05', 'volume_size': 1} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:38 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 1073741824" returned: 0 in 1.418s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:38 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 Jul 11 18:00:38 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:39 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5" returned: 0 in 0.780s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484228239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb638a5-e804-4f6f-8f27-9441a84a7f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd6c78875454c7596df41374dd9f56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:38Z,use_quota=True,user_id='0f20169c65aa4e9a94ad583a8de45de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Creating volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:39 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:39 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 1073741824 Jul 11 18:00:39 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e7881-e919-4df8-838a-03b07815a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d338714-374f-454e-bb96-afb7f7245ef5', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fd3da1-d384-4bea-a552-4aa2c16a6f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Volume volume-2d338714-374f-454e-bb96-afb7f7245ef5 (2d338714-374f-454e-bb96-afb7f7245ef5): created successfully Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fd3da1-d384-4bea-a552-4aa2c16a6f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Flow 'volume_create_manager' (45aca1f9-27de-431c-bdfd-ef2e64617f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-10224cad-ff90-49b1-8577-fe90f5e61a37 tempest-VolumesTransfersV355Test-1336579233 None] Created volume successfully. Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "cinder-2d338714-374f-454e-bb96-afb7f7245ef5-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-2d338714-374f-454e-bb96-afb7f7245ef5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "cinder-quobyte-2d338714-374f-454e-bb96-afb7f7245ef5" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-quobyte-2d338714-374f-454e-bb96-afb7f7245ef5" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[62358f57-f11d-4ee6-9063-0927c32946f0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:40 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 1073741824" returned: 0 in 1.232s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:40 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:00:40 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:40 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 Jul 11 18:00:40 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:41 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 0.796s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39482865-66f0-46e0-8af9-513e9f334033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f3ca1a-5ec1-4696-8aa8-6abfc7ef2539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Volume volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 (6cb638a5-e804-4f6f-8f27-9441a84a7f05): created successfully Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f3ca1a-5ec1-4696-8aa8-6abfc7ef2539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Flow 'volume_create_manager' (42710ac4-2ac2-47ff-b8cc-24fab017057c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-dc0e9023-3615-480e-b738-3d2d84be4a8b tempest-VolumesActionsTest-837393506 None] Created volume successfully. Jul 11 18:00:41 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5" returned: 0 in 1.024s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:41 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5 Jul 11 18:00:41 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:42 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2d338714-374f-454e-bb96-afb7f7245ef5" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-quobyte-2d338714-374f-454e-bb96-afb7f7245ef5" released by "delete_volume" :: held 1.820s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Created reservations ['10e6bc57-1553-466f-8031-5c1fc43d7e3f', '2fd65a2e-b1b7-42c6-804b-11df87e82dac', '262f9594-3752-4727-ac56-d2ec233a09ba', 'cf285724-6584-4a8e-9a7a-854a16bebfb4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:42 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:00:42 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:43 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.083s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:43 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:00:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Deleted volume successfully. Jul 11 18:00:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b2973d9e-f1b6-4d13-84af-a23dc1217245 tempest-VolumesTransfersV355Test-237029061 None] Lock "cinder-2d338714-374f-454e-bb96-afb7f7245ef5-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:INSERT=34,cinder:UPDATE=109,cinder:SELECT=82,cinder:DELETE=9 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Flow 'volume_create_manager' (e3aa7ba8-2891-4282-aecd-0af9f99d5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df495429-94d1-463e-934d-ac840463c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df495429-94d1-463e-934d-ac840463c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1370553370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f1909c-6181-4d88-a709-e56c74f96737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1f1970b6a144a2a340339c000b40a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:50Z,use_quota=True,user_id='745f59fe7a0e4684ad6e7b34575b6d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc32c88-f46a-4062-bbf0-66684b7e8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc32c88-f46a-4062-bbf0-66684b7e8052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62de2b8-1b9e-41ab-b55b-eef11bd3f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62de2b8-1b9e-41ab-b55b-eef11bd3f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f1909c-6181-4d88-a709-e56c74f96737', 'volume_name': 'volume-e3f1909c-6181-4d88-a709-e56c74f96737', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44666aa8-92b9-4cba-8ab6-031fa1536bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44666aa8-92b9-4cba-8ab6-031fa1536bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c38b8b-6834-42d2-b231-f8c93df5bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:49 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Volume e3f1909c-6181-4d88-a709-e56c74f96737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f1909c-6181-4d88-a709-e56c74f96737', 'volume_size': 1} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1370553370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f1909c-6181-4d88-a709-e56c74f96737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1f1970b6a144a2a340339c000b40a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:50Z,use_quota=True,user_id='745f59fe7a0e4684ad6e7b34575b6d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Creating volume e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:00:49 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:00:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:49 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 1073741824 Jul 11 18:00:49 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:50 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 1073741824" returned: 0 in 1.006s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:51 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:00:51 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:51 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 1.005s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c38b8b-6834-42d2-b231-f8c93df5bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f1909c-6181-4d88-a709-e56c74f96737', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204926b4-38c5-41f5-8cc6-f4fa16eee651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:52 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Volume volume-e3f1909c-6181-4d88-a709-e56c74f96737 (e3f1909c-6181-4d88-a709-e56c74f96737): created successfully Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204926b4-38c5-41f5-8cc6-f4fa16eee651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Flow 'volume_create_manager' (e3aa7ba8-2891-4282-aecd-0af9f99d5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:52 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3c5d2ba6-fd02-4723-87e7-34f83b410edd tempest-VolumesCloneTest-1587549879 None] Created volume successfully. Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Flow 'volume_create_manager' (ae3ccd76-1ee5-434e-9cfd-6f83633d73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867cdfb-bedc-4fd6-9ee0-d08b90b20c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867cdfb-bedc-4fd6-9ee0-d08b90b20c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2052619029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1f1970b6a144a2a340339c000b40a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:00:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e3f1909c-6181-4d88-a709-e56c74f96737,status='creating',terminated_at=None,updated_at=2026-07-11T16:00:54Z,use_quota=True,user_id='745f59fe7a0e4684ad6e7b34575b6d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddef9ce-830b-4a02-bb3f-711fdcbd393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddef9ce-830b-4a02-bb3f-711fdcbd393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34c3c31-4787-4c9a-8284-51f08abe64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34c3c31-4787-4c9a-8284-51f08abe64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f', 'volume_name': 'volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f', 'volume_size': 2, 'source_volid': 'e3f1909c-6181-4d88-a709-e56c74f96737', 'source_volstatus': 'available'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69ef9e3-a34a-43ef-a4cd-a4e0fec122df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69ef9e3-a34a-43ef-a4cd-a4e0fec122df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8243d2ba-51c6-44fb-bcd8-b55fb491c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:00:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Volume 10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f', 'volume_size': 2, 'source_volid': 'e3f1909c-6181-4d88-a709-e56c74f96737', 'source_volstatus': 'available'} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:00:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:00:53 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Cloning volume e3f1909c-6181-4d88-a709-e56c74f96737 to volume 10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f Jul 11 18:00:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Creating offline snapshot c0471456-6942-4f82-a847-08ec5f7b1f8f of volume e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:00:54 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5c3a3-60bc-4e78-8e21-e3ee3acdd79b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:00:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:54 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:00:54 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:54 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 0.851s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:54 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f 1G Jul 11 18:00:54 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:56 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f 1G" returned: 0 in 1.193s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f1909c-6181-4d88-a709-e56c74f96737 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:56 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f1909c-6181-4d88-a709-e56c74f96737 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:00:56 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:57 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f1909c-6181-4d88-a709-e56c74f96737 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 0.950s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:57 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f is being set with open permissions: ugo+rw Jul 11 18:00:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:57 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:00:57 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:58 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 1.115s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:58 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info Jul 11 18:00:58 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:00:59 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 11 18:00:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info" returned: 0 in 0.834s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:00:59 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info is being set with open permissions: ugo+rw Jul 11 18:00:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:00:59 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info Jul 11 18:00:59 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:00 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.info" returned: 0 in 0.982s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] snapshot: c0471456-6942-4f82-a847-08ec5f7b1f8f, volume: 10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dab11e-901a-48a7-b6b7-deb1c563d645]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:00 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:01:00 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:01 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 0.990s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3f1909c-6181-4d88-a709-e56c74f96737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e6c4b-4eed-4350-a0e1-5e0224125a9c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:01 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:01:01 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:02 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 1.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:02 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:01:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:02 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f Jul 11 18:01:02 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d1ec28e-3881-487a-b951-7a704c6becf5 tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" by "attach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d1ec28e-3881-487a-b951-7a704c6becf5 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" acquired by "attach_volume" :: waited 0.044s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9d1ec28e-3881-487a-b951-7a704c6becf5 tempest-VolumesActionsTest-837393506 None] Attaching volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05 to instance 2507ee0f-15fb-45dd-bbb0-186d86d98c46 at mountpoint /dev/vdb on host None. Jul 11 18:01:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9d1ec28e-3881-487a-b951-7a704c6becf5 tempest-VolumesActionsTest-837393506 None] Attach volume completed successfully. Jul 11 18:01:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d1ec28e-3881-487a-b951-7a704c6becf5 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" released by "attach_volume" :: held 0.246s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62bfa057-04af-4161-87b8-20d10c680040 tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" by "detach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62bfa057-04af-4161-87b8-20d10c680040 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" acquired by "detach_volume" :: waited 0.119s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-62bfa057-04af-4161-87b8-20d10c680040 tempest-VolumesActionsTest-837393506 None] Detaching volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05 from instance 2507ee0f-15fb-45dd-bbb0-186d86d98c46. Jul 11 18:01:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-62bfa057-04af-4161-87b8-20d10c680040 tempest-VolumesActionsTest-837393506 None] Detach volume completed successfully. Jul 11 18:01:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62bfa057-04af-4161-87b8-20d10c680040 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" released by "detach_volume" :: held 0.321s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:13 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" returned: 0 in 10.210s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:13 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[154f627b-cdbb-432d-a1cb-27c1c8d61930]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:13 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:01:13 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:14 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 1.276s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:14 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737, size 1024.00 MB, duration 10.21 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:01:14 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Converted 1024.00 MB image at 100.27 MB/s Jul 11 18:01:14 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f is being set with open permissions: ugo+rw Jul 11 18:01:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:14 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f Jul 11 18:01:14 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:15 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" released by "_copy_volume_from_snapshot" :: held 14.939s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-quobyte-c0471456-6942-4f82-a847-08ec5f7b1f8f" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-c0471456-6942-4f82-a847-08ec5f7b1f8f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Deleting offline snapshot c0471456-6942-4f82-a847-08ec5f7b1f8f of volume e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] snapshot_file for this snap is: volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582727b-186e-4130-866d-f2b54c421130]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:15 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:01:15 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:15 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3f1909c-6181-4d88-a709-e56c74f96737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f70963-e454-4a63-8c20-eab9d47d2431]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:16 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:01:16 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:16 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:01:16 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 0.874s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:16 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:01:16 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:17 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 0.837s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:17 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f Jul 11 18:01:17 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:18 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737.c0471456-6942-4f82-a847-08ec5f7b1f8f" returned: 0 in 0.905s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-c0471456-6942-4f82-a847-08ec5f7b1f8f" released by "_delete_snapshot" :: held 3.524s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=81,cinder:SELECT=63,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.696s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8243d2ba-51c6-44fb-bcd8-b55fb491c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f', 'volume_size': 2, 'source_volid': 'e3f1909c-6181-4d88-a709-e56c74f96737', 'source_volstatus': 'available'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c9a6ae-9e9d-4f6f-95ea-f9b41b5b150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Volume volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f (10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f): created successfully Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c9a6ae-9e9d-4f6f-95ea-f9b41b5b150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Flow 'volume_create_manager' (ae3ccd76-1ee5-434e-9cfd-6f83633d73a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:18 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-077edc91-0ef9-4d86-89d6-e76f74539707 tempest-VolumesCloneTest-1587549879 None] Created volume successfully. Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "cinder-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" acquired by "delete_volume" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05cade2-b8a8-48fb-b6d4-6bdacf25882c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:19 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f Jul 11 18:01:19 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:20 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" returned: 0 in 0.924s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:20 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f Jul 11 18:01:20 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:21 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" returned: 0 in 0.827s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f" released by "delete_volume" :: held 1.837s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Created reservations ['be48f936-7404-44bb-9b86-a18fa32ccaad', '5c145d52-828c-4950-ac9e-fbed1de878d9', '84a5ed32-190d-49ae-a7a0-ea58c6b48ba7', '2e39d4aa-2a3d-409f-848e-3885bec06d7d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:21 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:01:21 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-e3f1909c-6181-4d88-a709-e56c74f96737-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "cinder-e3f1909c-6181-4d88-a709-e56c74f96737-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Acquiring lock "cinder-quobyte-e3f1909c-6181-4d88-a709-e56c74f96737" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-e3f1909c-6181-4d88-a709-e56c74f96737" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe0ed1-2512-49b6-b9ec-fc6ea5cef99a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:22 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:01:22 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:22 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:22 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:01:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Deleted volume successfully. Jul 11 18:01:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-674be28f-b78c-465d-a426-5cf1971b47ca tempest-VolumesCloneTest-1587549879 None] Lock "cinder-10ba1b05-a567-4ced-bfdc-b32dfb8ebb3f-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:22 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 0.813s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:22 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737 Jul 11 18:01:22 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:23 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e3f1909c-6181-4d88-a709-e56c74f96737" returned: 0 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "cinder-quobyte-e3f1909c-6181-4d88-a709-e56c74f96737" released by "delete_volume" :: held 1.625s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Created reservations ['1763cefc-388e-40b1-a49c-2883e1e04355', 'c84b1966-510d-48d2-964c-0b5bc47a9d99', '27ee2ad1-d94d-40da-b796-d9023a835b34', '0e810248-d45b-4114-a96c-f88601181c10'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:23 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:01:23 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (71fb9ac2-2db6-48e4-8c9c-fcfa3bb7db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583c2610-3f0c-4831-8a48-923e0f1d34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583c2610-3f0c-4831-8a48-923e0f1d34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2074781627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0050b429-e819-42db-b9f9-e273776da77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:25Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428047af-4589-47fe-b948-6d444064cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428047af-4589-47fe-b948-6d444064cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ab9962-7ece-4ade-9b39-8fdcdaacff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ab9962-7ece-4ade-9b39-8fdcdaacff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0050b429-e819-42db-b9f9-e273776da77a', 'volume_name': 'volume-0050b429-e819-42db-b9f9-e273776da77a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21015449-86cf-46c9-9c20-8e2816c89ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21015449-86cf-46c9-9c20-8e2816c89ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce76a12-89eb-45c6-8694-c9d0671620a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Volume 0050b429-e819-42db-b9f9-e273776da77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0050b429-e819-42db-b9f9-e273776da77a', 'volume_size': 1} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2074781627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0050b429-e819-42db-b9f9-e273776da77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:25Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Creating volume 0050b429-e819-42db-b9f9-e273776da77a {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:01:25 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:25 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.536s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:01:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Deleted volume successfully. Jul 11 18:01:25 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a 1073741824 Jul 11 18:01:25 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951bf596-d21e-458e-b081-08bd9d73ac2c tempest-VolumesCloneTest-1587549879 None] Lock "cinder-e3f1909c-6181-4d88-a709-e56c74f96737-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:26 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a 1073741824" returned: 0 in 1.655s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:26 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a Jul 11 18:01:26 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:27 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a" returned: 0 in 0.691s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.447s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce76a12-89eb-45c6-8694-c9d0671620a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0050b429-e819-42db-b9f9-e273776da77a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5fe6f-e6d9-446a-90f1-c5c76cbd13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:27 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Volume volume-0050b429-e819-42db-b9f9-e273776da77a (0050b429-e819-42db-b9f9-e273776da77a): created successfully Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5fe6f-e6d9-446a-90f1-c5c76cbd13e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (71fb9ac2-2db6-48e4-8c9c-fcfa3bb7db27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d5e5d2a5-e732-4aff-a2bd-540e1e932eb4 tempest-AttachVolumeNegativeTest-1823960188 None] Created volume successfully. Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Flow 'volume_create_manager' (b7686154-ddf7-4e89-a6d1-27b842bc4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573a4d1a-4652-4436-848b-0d18e1c715a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573a4d1a-4652-4436-848b-0d18e1c715a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1347683825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b49b6d-28ed-4712-9b49-192db459b4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612a081cb07d4f96878ffc1f7eb38195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:31Z,use_quota=True,user_id='89149b92b30149ca8bbf21f6a987d5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9777e2cb-551c-4bad-aed1-99ee54dedd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9777e2cb-551c-4bad-aed1-99ee54dedd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3b270a-9dc2-4cb5-b2a0-c707cfa02d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3b270a-9dc2-4cb5-b2a0-c707cfa02d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b49b6d-28ed-4712-9b49-192db459b4af', 'volume_name': 'volume-18b49b6d-28ed-4712-9b49-192db459b4af', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29428bb6-2714-41c9-8b04-13323ad928d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29428bb6-2714-41c9-8b04-13323ad928d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eece9d3e-6363-4b03-82ec-d99e419e88ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:31 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Volume 18b49b6d-28ed-4712-9b49-192db459b4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b49b6d-28ed-4712-9b49-192db459b4af', 'volume_size': 1} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1347683825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b49b6d-28ed-4712-9b49-192db459b4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612a081cb07d4f96878ffc1f7eb38195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:31Z,use_quota=True,user_id='89149b92b30149ca8bbf21f6a987d5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Creating volume 18b49b6d-28ed-4712-9b49-192db459b4af {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:01:31 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:31 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af 1073741824 Jul 11 18:01:31 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:32 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af 1073741824" returned: 0 in 0.897s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:32 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af Jul 11 18:01:32 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:32 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af" returned: 0 in 0.676s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:01:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.569s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eece9d3e-6363-4b03-82ec-d99e419e88ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b49b6d-28ed-4712-9b49-192db459b4af', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f427752-cc64-47e3-b8a6-f138c0e4ae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae086e0-a8c8-43d6-93ee-b2d158566e16]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Volume volume-18b49b6d-28ed-4712-9b49-192db459b4af (18b49b6d-28ed-4712-9b49-192db459b4af): created successfully Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f427752-cc64-47e3-b8a6-f138c0e4ae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Flow 'volume_create_manager' (b7686154-ddf7-4e89-a6d1-27b842bc4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4831e912-a0bf-44d2-a7f2-7ed1dcb4ebbc tempest-VolumesNegativeTest-745253095 None] Created volume successfully. Jul 11 18:01:33 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a Jul 11 18:01:33 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:33 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a" returned: 0 in 0.905s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-0050b429-e819-42db-b9f9-e273776da77a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14c91b06-79a2-4912-b571-c586420e81cd', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:01:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-78db7bb2-a948-4d16-abb1-3f9e0fd2a456 req-b5cec9cc-4cfb-4c2c-a671-e79dd27c3cf3 tempest-AttachVolumeNegativeTest-1823960188 None] attachment_update completed successfully. Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:34 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:01:34 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea9d59b-46fa-4b52-9da7-b4dd9190f062 tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" by "attach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea9d59b-46fa-4b52-9da7-b4dd9190f062 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" acquired by "attach_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fea9d59b-46fa-4b52-9da7-b4dd9190f062 tempest-VolumesActionsTest-837393506 None] Attaching volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05 to instance ab9ee473-2582-430d-b435-d5bd4481e94e at mountpoint /dev/vdb on host None. Jul 11 18:01:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fea9d59b-46fa-4b52-9da7-b4dd9190f062 tempest-VolumesActionsTest-837393506 None] Attach volume completed successfully. Jul 11 18:01:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea9d59b-46fa-4b52-9da7-b4dd9190f062 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05" released by "attach_volume" :: held 0.120s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:35 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.924s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d63d5587-0fa3-434f-b5f7-c83d34046305 tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" by "detach_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d63d5587-0fa3-434f-b5f7-c83d34046305 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:01:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d63d5587-0fa3-434f-b5f7-c83d34046305 tempest-VolumesActionsTest-837393506 None] Detaching volume 6cb638a5-e804-4f6f-8f27-9441a84a7f05 from instance ab9ee473-2582-430d-b435-d5bd4481e94e. Jul 11 18:01:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d63d5587-0fa3-434f-b5f7-c83d34046305 tempest-VolumesActionsTest-837393506 None] Detach volume completed successfully. Jul 11 18:01:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d63d5587-0fa3-434f-b5f7-c83d34046305 tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Flow 'volume_create_manager' (baf1651d-402b-40b9-a18d-38f2140dc725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ca50e-c27f-4a40-ad31-dd9aedca305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ca50e-c27f-4a40-ad31-dd9aedca305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-388214829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93992723-07f6-4941-9207-f1c49307ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa659bc9cda49bbae7883728ed05957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:40Z,use_quota=True,user_id='1f27b1d088524c3fac1754deecba7aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407b9194-8c2c-4397-8900-70dca352d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407b9194-8c2c-4397-8900-70dca352d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a7547-dd71-49bf-b52e-c3da16713603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a7547-dd71-49bf-b52e-c3da16713603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93992723-07f6-4941-9207-f1c49307ed02', 'volume_name': 'volume-93992723-07f6-4941-9207-f1c49307ed02', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09df315-848a-4304-9425-84820667b844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09df315-848a-4304-9425-84820667b844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8158bba-531a-4b23-835c-68acd37d65c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:40 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Volume 93992723-07f6-4941-9207-f1c49307ed02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93992723-07f6-4941-9207-f1c49307ed02', 'volume_size': 1} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-388214829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93992723-07f6-4941-9207-f1c49307ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa659bc9cda49bbae7883728ed05957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:01:40Z,use_quota=True,user_id='1f27b1d088524c3fac1754deecba7aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Creating volume 93992723-07f6-4941-9207-f1c49307ed02 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:01:40 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:01:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:40 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 1073741824 Jul 11 18:01:40 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-766442c0-cd9d-4845-ab40-26b4f2777ae2 req-ddae569e-e0c4-4ae4-9a27-df0d6ec5529e tempest-AttachVolumeNegativeTest-1823960188 None] Terminate volume connection completed successfully. Jul 11 18:01:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-766442c0-cd9d-4845-ab40-26b4f2777ae2 req-ddae569e-e0c4-4ae4-9a27-df0d6ec5529e tempest-AttachVolumeNegativeTest-1823960188 None] Deleting attachment 14c91b06-79a2-4912-b571-c586420e81cd. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:01:41 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 1073741824" returned: 0 in 1.101s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:41 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 Jul 11 18:01:41 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:42 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02" returned: 0 in 0.805s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8158bba-531a-4b23-835c-68acd37d65c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93992723-07f6-4941-9207-f1c49307ed02', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad9cdd9-3eec-4759-b753-72abf9a00808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:01:42 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Volume volume-93992723-07f6-4941-9207-f1c49307ed02 (93992723-07f6-4941-9207-f1c49307ed02): created successfully Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad9cdd9-3eec-4759-b753-72abf9a00808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:01:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Flow 'volume_create_manager' (baf1651d-402b-40b9-a18d-38f2140dc725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:01:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6741fb11-a832-4ed9-afe6-c779f92b5238 tempest-AttachVolumeShelveTestJSON-142956002 None] Created volume successfully. Jul 11 18:01:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:01:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:01:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[352be47e-57b9-491b-9637-52582891204d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:45 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:01:45 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:46 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 1.210s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b72ba-5275-41bb-afa1-7055c6fd44b5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:46 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:01:46 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:47 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 1.070s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.7949a951-8b25-4754-a2d5-6d1d746f1ea2m5ob1oz1.img {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:47 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.7949a951-8b25-4754-a2d5-6d1d746f1ea2m5ob1oz1.img Jul 11 18:01:47 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:52 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=30,cinder:INSERT=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:01:55 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=36,cinder:SELECT=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:01:55 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.7949a951-8b25-4754-a2d5-6d1d746f1ea2m5ob1oz1.img" returned: 0 in 7.729s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[04159c08-4ab7-4c69-9ff2-f906b37b336d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:01:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:01:55 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:01:55 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:01:56 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 11 18:01:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 1.259s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:01:56 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.7949a951-8b25-4754-a2d5-6d1d746f1ea2m5ob1oz1.img {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:01:56 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Converted 1024.00 MB image at 132.47 MB/s Jul 11 18:01:56 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] 7949a951-8b25-4754-a2d5-6d1d746f1ea2 was raw, no need to convert to raw {{(pid=86932) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 11 18:02:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-6463e301-ed87-4fe7-b2ea-71e66408b0ea req-65e5c923-f313-4fcf-8755-751a447bbee8 tempest-AttachVolumeShelveTestJSON-142956002 None] No connector for attachment 213a0dcb-a46c-445a-b371-3f2f6bd5804a; skipping storage backend terminate_connection call. {{(pid=86932) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 11 18:02:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-6463e301-ed87-4fe7-b2ea-71e66408b0ea req-65e5c923-f313-4fcf-8755-751a447bbee8 tempest-AttachVolumeShelveTestJSON-142956002 None] Deleting attachment 213a0dcb-a46c-445a-b371-3f2f6bd5804a. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Acquiring lock "cinder-18b49b6d-28ed-4712-9b49-192db459b4af-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "cinder-18b49b6d-28ed-4712-9b49-192db459b4af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Acquiring lock "cinder-quobyte-18b49b6d-28ed-4712-9b49-192db459b4af" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "cinder-quobyte-18b49b6d-28ed-4712-9b49-192db459b4af" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceaef6c-2ccb-4bdd-a730-79c172d36d2f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:10 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af Jul 11 18:02:10 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:10 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:10 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af Jul 11 18:02:10 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:11 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18b49b6d-28ed-4712-9b49-192db459b4af" returned: 0 in 1.057s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "cinder-quobyte-18b49b6d-28ed-4712-9b49-192db459b4af" released by "delete_volume" :: held 2.026s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Created reservations ['b852a382-72c0-4150-a1b4-63d800c075fd', '7044b4a4-1ee6-45d1-900a-27f8e2b5c2a5', 'f12d3dbb-dbbe-40aa-ad8a-9748ae808b53', 'dbe9eb15-6bef-4103-ba81-1fed5c38d126'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:12 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:02:12 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:12 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.746s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:02:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Deleted volume successfully. Jul 11 18:02:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-848697de-575f-4be0-a35d-cbd65b7f3c6c tempest-VolumesNegativeTest-745253095 None] Lock "cinder-18b49b6d-28ed-4712-9b49-192db459b4af-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:22 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:02:22 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:02:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.266s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Uploaded volume to glance image-id: 7949a951-8b25-4754-a2d5-6d1d746f1ea2. {{(pid=86932) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:02:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-40398937-587a-425f-97db-d241e09e4e95 tempest-VolumesActionsTest-837393506 None] Copy volume to image completed successfully. Jul 11 18:02:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28260422-e986-40f2-85e5-b4d2e02bd1af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:28 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:02:28 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:29 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 1.107s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75a64b-25a9-49a0-9cae-90151771d86d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:29 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:02:29 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (5c514147-fb59-45bb-a83e-b0a629c9d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8dc822-8fb3-4f89-8fc4-7e6c5c38521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8dc822-8fb3-4f89-8fc4-7e6c5c38521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045388905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78123621-9076-42fe-8233-fcb041d624ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:31Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbc2374-3d3d-4bd3-afe6-0d51bd95ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbc2374-3d3d-4bd3-afe6-0d51bd95ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab38536-d02c-4d31-af75-6eb5a462bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab38536-d02c-4d31-af75-6eb5a462bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78123621-9076-42fe-8233-fcb041d624ff', 'volume_name': 'volume-78123621-9076-42fe-8233-fcb041d624ff', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f87234-5e36-42fc-afd3-59ea9204f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f87234-5e36-42fc-afd3-59ea9204f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bc3eee-681f-4c9c-8cfc-edbd9ad8727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Volume 78123621-9076-42fe-8233-fcb041d624ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78123621-9076-42fe-8233-fcb041d624ff', 'volume_size': 1} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:30 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 0.980s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:30 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img Jul 11 18:02:30 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:02:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:02:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:02:37 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img" returned: 0 in 6.717s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3b9dc-7644-44e8-bf9e-f2dec6a8b621]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:37 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:02:37 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:38 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 0.941s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:38 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:02:38 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Converted 1024.00 MB image at 152.43 MB/s Jul 11 18:02:38 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] 64b00355-d84f-40b5-b0f5-65ef677bbc12 was raw, converting to qcow2 {{(pid=86932) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 11 18:02:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab82e58-0687-4b62-b0da-b0e5b3f10e52]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:38 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img Jul 11 18:02:38 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:39 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img" returned: 0 in 0.877s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:39 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img Jul 11 18:02:39 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (39e4ad88-c6d1-4a06-b1cd-38e27d9f952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47756835-84ca-4385-850a-f72a7a1fb419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47756835-84ca-4385-850a-f72a7a1fb419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-93707748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e07203-db06-4e1b-962f-8a71fc0e1140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:40Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad648b-5b3e-473a-a48d-15a02e721130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad648b-5b3e-473a-a48d-15a02e721130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7834ffe-62ca-47a6-8a83-49f606e78e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7834ffe-62ca-47a6-8a83-49f606e78e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e07203-db06-4e1b-962f-8a71fc0e1140', 'volume_name': 'volume-44e07203-db06-4e1b-962f-8a71fc0e1140', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b03cb46-746b-432e-972c-95f28aa80f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b03cb46-746b-432e-972c-95f28aa80f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b8b04b-bd9f-42e3-909e-d356b6924a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Volume 44e07203-db06-4e1b-962f-8a71fc0e1140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e07203-db06-4e1b-962f-8a71fc0e1140', 'volume_size': 1} Jul 11 18:02:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:40 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img" returned: 1 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img /opt/stack/data/cinder/conversion/vol_upload_84ry0die {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:40 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img /opt/stack/data/cinder/conversion/vol_upload_84ry0die Jul 11 18:02:40 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:40 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img /opt/stack/data/cinder/conversion/vol_upload_84ry0die" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Image conversion details: src /opt/stack/data/cinder/conversion/6cb638a5-e804-4f6f-8f27-9441a84a7f05.temp_image.64b00355-d84f-40b5-b0f5-65ef677bbc12v6d1_3r7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_84ry0die {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:02:40 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172d972-bac4-42ce-bd8f-42f00caf82ff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84ry0die {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:41 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84ry0die Jul 11 18:02:41 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:41 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84ry0die" returned: 0 in 0.747s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.272s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Uploaded volume to glance image-id: 64b00355-d84f-40b5-b0f5-65ef677bbc12. {{(pid=86932) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.162s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045388905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78123621-9076-42fe-8233-fcb041d624ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:31Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Creating volume 78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:02:42 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:02:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:43 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff 1073741824 Jul 11 18:02:43 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d1d9a28e-3d95-4475-af97-0dd1fca50836 tempest-VolumesActionsTest-837393506 None] Copy volume to image completed successfully. Jul 11 18:02:43 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff 1073741824" returned: 0 in 0.933s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:44 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff Jul 11 18:02:44 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Acquiring lock "cinder-quobyte-6cb638a5-e804-4f6f-8f27-9441a84a7f05" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "cinder-quobyte-6cb638a5-e804-4f6f-8f27-9441a84a7f05" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[62545f1f-a958-40fb-b946-73897b9c7592]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:44 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:02:44 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:44 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff" returned: 0 in 0.713s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.951s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-93707748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e07203-db06-4e1b-962f-8a71fc0e1140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd204507fe44b52a57ccf45355bc673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:40Z,use_quota=True,user_id='841aa3855f064c30afbe5bd2a315e97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Creating volume 44e07203-db06-4e1b-962f-8a71fc0e1140 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:02:44 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:44 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 1073741824 Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bc3eee-681f-4c9c-8cfc-edbd9ad8727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78123621-9076-42fe-8233-fcb041d624ff', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:44 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f798cb65-3474-437d-afd8-612725e13a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:44 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Volume volume-78123621-9076-42fe-8233-fcb041d624ff (78123621-9076-42fe-8233-fcb041d624ff): created successfully Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f798cb65-3474-437d-afd8-612725e13a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (5c514147-fb59-45bb-a83e-b0a629c9d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c73f8722-a352-4e39-9746-54af111da4fc tempest-VolumesSnapshotTestJSON-845996043 None] Created volume successfully. Jul 11 18:02:45 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 0.981s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:45 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05 Jul 11 18:02:45 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:45 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 1073741824" returned: 0 in 1.076s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:45 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 Jul 11 18:02:45 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:46 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6cb638a5-e804-4f6f-8f27-9441a84a7f05" returned: 0 in 0.690s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "cinder-quobyte-6cb638a5-e804-4f6f-8f27-9441a84a7f05" released by "delete_volume" :: held 1.710s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Created reservations ['2f4295ca-d65e-4b57-adc0-3e982f4d6106', 'de016bef-2eed-4355-b498-39c22e300de3', '2078149b-e106-4952-ac89-f564afad35c5', '24306fd3-0430-419a-9a63-1ec03586ca1e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:46 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:02:46 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:46 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140" returned: 0 in 0.683s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.921s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b8b04b-bd9f-42e3-909e-d356b6924a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e07203-db06-4e1b-962f-8a71fc0e1140', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bac5ea-fc88-4401-9eaa-264dd0ff64e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Creating offline snapshot 193ab42a-0ea3-4a08-9724-41b2faa8db7c of volume 78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:02:46 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Volume volume-44e07203-db06-4e1b-962f-8a71fc0e1140 (44e07203-db06-4e1b-962f-8a71fc0e1140): created successfully Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bac5ea-fc88-4401-9eaa-264dd0ff64e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Flow 'volume_create_manager' (39e4ad88-c6d1-4a06-b1cd-38e27d9f952c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d1448-66e4-4988-993a-e9cfc2042897]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-dd12d30a-4ac0-4cbb-8a1d-9152e03e30d2 tempest-AttachVolumeNegativeTest-1823960188 None] Created volume successfully. Jul 11 18:02:46 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff Jul 11 18:02:46 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:47 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.715s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:47 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:02:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Deleted volume successfully. Jul 11 18:02:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6306bf7e-08a0-4b37-aa42-890af011653c tempest-VolumesActionsTest-837393506 None] Lock "cinder-6cb638a5-e804-4f6f-8f27-9441a84a7f05-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:47 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff" returned: 0 in 0.825s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:47 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c 1G Jul 11 18:02:47 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:48 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c 1G" returned: 0 in 0.859s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78123621-9076-42fe-8233-fcb041d624ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:48 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78123621-9076-42fe-8233-fcb041d624ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c Jul 11 18:02:48 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:49 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78123621-9076-42fe-8233-fcb041d624ff -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:49 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c is being set with open permissions: ugo+rw Jul 11 18:02:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:49 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c Jul 11 18:02:49 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:49 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:49 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info Jul 11 18:02:49 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:50 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info" returned: 0 in 0.731s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:50 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info is being set with open permissions: ugo+rw Jul 11 18:02:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:50 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info Jul 11 18:02:50 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:51 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.info" returned: 0 in 0.675s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.939s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[100bba87-f408-4a32-ba8c-635d64ce8f31]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2ff22bda-54a0-4e1f-bc8f-79b811a697fb tempest-VolumesSnapshotTestJSON-845996043 None] Create snapshot completed successfully Jul 11 18:02:51 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 Jul 11 18:02:51 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-193ab42a-0ea3-4a08-9724-41b2faa8db7c-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-193ab42a-0ea3-4a08-9724-41b2faa8db7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:52 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140" returned: 0 in 0.823s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-44e07203-db06-4e1b-962f-8a71fc0e1140', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd83eaf7c-61dd-4528-830d-777c62052d56', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-193ab42a-0ea3-4a08-9724-41b2faa8db7c" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-193ab42a-0ea3-4a08-9724-41b2faa8db7c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Deleting offline snapshot 193ab42a-0ea3-4a08-9724-41b2faa8db7c of volume 78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] snapshot_file for this snap is: volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5970dfe-04ab-4ce9-b330-5dd7123eb0b7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:52 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-83a41162-80b5-4cc5-91f8-02fe6c360511 req-6bcb08d2-08d6-4c67-95b3-834d2596ee27 tempest-AttachVolumeNegativeTest-1823960188 None] attachment_update completed successfully. Jul 11 18:02:52 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c Jul 11 18:02:52 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:53 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78123621-9076-42fe-8233-fcb041d624ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff6dae9-b4a3-4a60-bd8b-edb89f683047]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:53 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff Jul 11 18:02:53 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:53 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff" returned: 0 in 0.885s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:53 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c Jul 11 18:02:53 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:54 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c" returned: 0 in 0.822s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:54 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c Jul 11 18:02:54 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:55 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff.193ab42a-0ea3-4a08-9724-41b2faa8db7c" returned: 0 in 0.712s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-193ab42a-0ea3-4a08-9724-41b2faa8db7c" released by "_delete_snapshot" :: held 3.357s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" released by "delete_snapshot" :: held 3.393s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['150d2825-3515-4625-8280-94ed000bd390', '58ad8d01-d779-4b6d-9b65-1cd119277622', 'e0cc3586-100d-4cce-9d5b-f7b0f5a696e6', '5b4ac1cc-6946-478e-b20c-3e34ce1209b6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:02:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Delete snapshot completed successfully. Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a8cf9bcc-e1c3-442c-86b4-c3beafa0113a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-193ab42a-0ea3-4a08-9724-41b2faa8db7c-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Flow 'volume_create_manager' (fca2f77d-6edb-41d8-a24b-7b397a8d2e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7890e3-3097-496b-8d9e-5181beb40379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7890e3-3097-496b-8d9e-5181beb40379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc28b4f-de23-4af0-86a5-f92f848016c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14da826e03db482a945f8eb37fb602f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:56Z,use_quota=True,user_id='8f2e7542be6c45849ec064506ab38d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855cdf35-482e-4255-a346-184c488b3c8e),volume_type_id=855cdf35-482e-4255-a346-184c488b3c8e)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2780776-4ce2-4a17-ac3a-3ed535fc5a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2780776-4ce2-4a17-ac3a-3ed535fc5a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271ff2d-10d8-4af8-a657-25822b6b7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271ff2d-10d8-4af8-a657-25822b6b7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fc28b4f-de23-4af0-86a5-f92f848016c5', 'volume_name': 'volume-3fc28b4f-de23-4af0-86a5-f92f848016c5', 'volume_size': 1, 'image_id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2faec31871769dfa239a4cda05a5067e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14da826e03db482a945f8eb37fb602f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c80b3d72b9398c5c7ddd93500498700b9a03760c7b09dcac7b137debbbd7af323b5c1d975ec4cba590ad4d818c326da4921a9109d081905fd9d376497e3ca5', 'id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'created_at': datetime.datetime(2026, 7, 11, 16, 2, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0098c4e8-2685-4e55-990a-8fa5973d654d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf22f1-db66-4f87-9ac9-30520a44e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf22f1-db66-4f87-9ac9-30520a44e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a0b1b2-04ee-42fd-be42-8b3ff8c7d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:56 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Volume 3fc28b4f-de23-4af0-86a5-f92f848016c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fc28b4f-de23-4af0-86a5-f92f848016c5', 'volume_size': 1, 'image_id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2faec31871769dfa239a4cda05a5067e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14da826e03db482a945f8eb37fb602f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c80b3d72b9398c5c7ddd93500498700b9a03760c7b09dcac7b137debbbd7af323b5c1d975ec4cba590ad4d818c326da4921a9109d081905fd9d376497e3ca5', 'id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'created_at': datetime.datetime(2026, 7, 11, 16, 2, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0098c4e8-2685-4e55-990a-8fa5973d654d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Trying to clone 3fc28b4f-de23-4af0-86a5-f92f848016c5 from image 0098c4e8-2685-4e55-990a-8fa5973d654d at location (None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:02:56 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1aeee7-6ef2-4aac-a632-eaf2b2a1b4d9]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:56 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:02:56 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (7f4de4ee-c901-40f8-a0a6-a6991e99b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50c8027-7257-4275-957a-a9b2048863c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50c8027-7257-4275-957a-a9b2048863c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1573852362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b36f23-b873-4be3-944c-444400db569b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:57Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be7c043-a2f8-4ba7-9bf2-b8659a43fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be7c043-a2f8-4ba7-9bf2-b8659a43fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3943ec13-cd46-4f10-80cc-05417035293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3943ec13-cd46-4f10-80cc-05417035293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b36f23-b873-4be3-944c-444400db569b', 'volume_name': 'volume-87b36f23-b873-4be3-944c-444400db569b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a85915a-b897-45b8-8bbd-6aee3bb951b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a85915a-b897-45b8-8bbd-6aee3bb951b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460b19bd-4e90-46ca-987b-8722390673b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Volume 87b36f23-b873-4be3-944c-444400db569b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b36f23-b873-4be3-944c-444400db569b', 'volume_size': 1} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1573852362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b36f23-b873-4be3-944c-444400db569b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:57Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Creating volume 87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:02:57 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:57 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b 1073741824 Jul 11 18:02:57 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:57 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:57 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:02:57 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:58 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b 1073741824" returned: 0 in 0.922s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:58 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:02:58 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-ada2d25a-352a-481f-ac40-e90874737f19 req-7e0855fc-9e14-4ba8-a436-d95928575cd9 tempest-AttachVolumeNegativeTest-1823960188 None] Terminate volume connection completed successfully. Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-ada2d25a-352a-481f-ac40-e90874737f19 req-7e0855fc-9e14-4ba8-a436-d95928575cd9 tempest-AttachVolumeNegativeTest-1823960188 None] Deleting attachment d83eaf7c-61dd-4528-830d-777c62052d56. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:02:58 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 1 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Temporary image 0098c4e8-2685-4e55-990a-8fa5973d654d is fetched for user 8f2e7542be6c45849ec064506ab38d9e. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e7b017-1844-414f-98a2-e90a78b56f02]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:58 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:02:58 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:02:58 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 0.898s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:02:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460b19bd-4e90-46ca-987b-8722390673b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b36f23-b873-4be3-944c-444400db569b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b4368-bd73-4f5f-845d-4018797695af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:02:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Volume volume-87b36f23-b873-4be3-944c-444400db569b (87b36f23-b873-4be3-944c-444400db569b): created successfully Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b4368-bd73-4f5f-845d-4018797695af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (7f4de4ee-c901-40f8-a0a6-a6991e99b856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:02:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-460370f3-8c57-4b16-8255-60ad504be9ce tempest-VolumesSnapshotTestJSON-845996043 None] Created volume successfully. Jul 11 18:02:59 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 0 in 0.912s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:02:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:02:59 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:02:59 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:00 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 1 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc28b4f-de23-4af0-86a5-f92f848016c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14da826e03db482a945f8eb37fb602f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:02:56Z,use_quota=True,user_id='8f2e7542be6c45849ec064506ab38d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855cdf35-482e-4255-a346-184c488b3c8e),volume_type_id=855cdf35-482e-4255-a346-184c488b3c8e)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Creating volume 3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:00 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:00 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1073741824 Jul 11 18:03:00 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:01 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1073741824" returned: 0 in 0.963s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:01 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:01 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:01 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 0 in 0.664s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.449s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Creating offline snapshot 1bba2745-c72d-4869-9396-6b98d1c93d93 of volume 87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Attempting download of 0098c4e8-2685-4e55-990a-8fa5973d654d ((None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}])) to volume 3fc28b4f-de23-4af0-86a5-f92f848016c5. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f064494-57ca-4acf-bf3c-7e698829c4db]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503121a-1b04-46b2-91c6-c7ab40f603ea]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:02 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:02 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:02 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl Jul 11 18:03:02 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:02 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl" returned: 0 in 0.928s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:02 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 1.042s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:02 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 1G Jul 11 18:03:02 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:02 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl Jul 11 18:03:02 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:03 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl" returned: 1 in 0.837s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0098c4e8-2685-4e55-990a-8fa5973d654d_xb08ezvl' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b3d4d2-ff12-49d4-8823-1455f8c1b015]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:03 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:03:03 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:03 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 1G" returned: 0 in 0.961s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b36f23-b873-4be3-944c-444400db569b -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:03 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b36f23-b873-4be3-944c-444400db569b -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:03 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:04 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:04 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD Jul 11 18:03:04 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:04 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b36f23-b873-4be3-944c-444400db569b -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 0.829s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:04 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 is being set with open permissions: ugo+rw Jul 11 18:03:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:04 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:04 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Acquiring lock "cinder-93992723-07f6-4941-9207-f1c49307ed02-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "cinder-93992723-07f6-4941-9207-f1c49307ed02-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Acquiring lock "cinder-quobyte-93992723-07f6-4941-9207-f1c49307ed02" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "cinder-quobyte-93992723-07f6-4941-9207-f1c49307ed02" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7daf3-5620-4df8-bdb8-96294757d573]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:05 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 Jul 11 18:03:05 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:05 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] 0098c4e8-2685-4e55-990a-8fa5973d654d was raw, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:05 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:05 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:05 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 0.720s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:05 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info Jul 11 18:03:05 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:06 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02" returned: 0 in 0.861s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:06 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02 Jul 11 18:03:06 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:06 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0098c4e8-2685-4e55-990a-8fa5973d654d_nyiwe49sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:03:06 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:06 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1G Jul 11 18:03:06 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:06 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info" returned: 0 in 0.754s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info is being set with open permissions: ugo+rw Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:06 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info Jul 11 18:03:06 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:06 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93992723-07f6-4941-9207-f1c49307ed02" returned: 0 in 0.723s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "cinder-quobyte-93992723-07f6-4941-9207-f1c49307ed02" released by "delete_volume" :: held 1.634s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Created reservations ['7858007a-8ae0-4c28-8655-f4095c50f6af', 'bff63776-cc22-4ec9-9a3b-ef54b691d5c1', '124338be-cf3b-4c84-900f-7825e0da5717', '83437254-0f63-42c7-b45b-fc73a84740ea'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:06 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:06 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.info" returned: 0 in 0.723s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 1G" returned: 0 in 0.774s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:06 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:06 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.131s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0d294869-b0b1-4003-b915-213ffeda1af5 tempest-VolumesSnapshotTestJSON-845996043 None] Create snapshot completed successfully Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8329baf9-999e-467e-8bd4-8358413863bd]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:07 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:07 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:07 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Deleted volume successfully. Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-477dfdcc-fd30-4179-b2de-489ac664caf8 tempest-AttachVolumeShelveTestJSON-142956002 None] Lock "cinder-93992723-07f6-4941-9207-f1c49307ed02-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:07 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:08 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:08 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (b1a7509e-fb8c-4dac-8e9a-ab9fc0ba7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307a6ec8-a19a-4302-8048-072326944f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307a6ec8-a19a-4302-8048-072326944f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1407804198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a48363-b2ae-4743-af00-2e9b7885a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1bba2745-c72d-4869-9396-6b98d1c93d93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:08Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4fdb46-5f30-4d15-9430-ecc7295c5d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4fdb46-5f30-4d15-9430-ecc7295c5d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d75cec5-dbb2-4651-b445-8e86564505dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d75cec5-dbb2-4651-b445-8e86564505dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40a48363-b2ae-4743-af00-2e9b7885a515', 'volume_name': 'volume-40a48363-b2ae-4743-af00-2e9b7885a515', 'volume_size': 2, 'snapshot_id': '1bba2745-c72d-4869-9396-6b98d1c93d93'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3108c74-723d-4b60-9c32-df244e5e759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3108c74-723d-4b60-9c32-df244e5e759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132603d5-6564-4cd3-805f-21fa14298717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Volume 40a48363-b2ae-4743-af00-2e9b7885a515: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40a48363-b2ae-4743-af00-2e9b7885a515', 'volume_size': 2, 'snapshot_id': '1bba2745-c72d-4869-9396-6b98d1c93d93'} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93-40a48363-b2ae-4743-af00-2e9b7885a515" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93-40a48363-b2ae-4743-af00-2e9b7885a515" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Creating volume 40a48363-b2ae-4743-af00-2e9b7885a515 from snapshot 1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] snapshot: 1bba2745-c72d-4869-9396-6b98d1c93d93, volume: 40a48363-b2ae-4743-af00-2e9b7885a515, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85f8681-8103-4b55-b2a2-f7f04920cc94]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:08 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:08 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:08 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 1 in 1.016s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Downloaded image 0098c4e8-2685-4e55-990a-8fa5973d654d ((None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}])) to volume 3fc28b4f-de23-4af0-86a5-f92f848016c5 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Temporary image 0098c4e8-2685-4e55-990a-8fa5973d654d for user 8f2e7542be6c45849ec064506ab38d9e is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Marking volume 3fc28b4f-de23-4af0-86a5-f92f848016c5 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Copying metadata from image 0098c4e8-2685-4e55-990a-8fa5973d654d to 3fc28b4f-de23-4af0-86a5-f92f848016c5. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:03:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Creating volume glance metadata for volume 3fc28b4f-de23-4af0-86a5-f92f848016c5 backed by image 0098c4e8-2685-4e55-990a-8fa5973d654d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2faec31871769dfa239a4cda05a5067e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a0b1b2-04ee-42fd-be42-8b3ff8c7d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc28b4f-de23-4af0-86a5-f92f848016c5', 'volume_size': 1, 'image_id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0098c4e8-2685-4e55-990a-8fa5973d654d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2faec31871769dfa239a4cda05a5067e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14da826e03db482a945f8eb37fb602f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c80b3d72b9398c5c7ddd93500498700b9a03760c7b09dcac7b137debbbd7af323b5c1d975ec4cba590ad4d818c326da4921a9109d081905fd9d376497e3ca5', 'id': '0098c4e8-2685-4e55-990a-8fa5973d654d', 'created_at': datetime.datetime(2026, 7, 11, 16, 2, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0098c4e8-2685-4e55-990a-8fa5973d654d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2269655-d591-4fd4-abda-10226062fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Volume volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 (3fc28b4f-de23-4af0-86a5-f92f848016c5): created successfully Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2269655-d591-4fd4-abda-10226062fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Flow 'volume_create_manager' (fca2f77d-6edb-41d8-a24b-7b397a8d2e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0409ac50-3d4d-48f6-b32d-e51786d7bb2f tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Created volume successfully. Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-44e07203-db06-4e1b-962f-8a71fc0e1140-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-44e07203-db06-4e1b-962f-8a71fc0e1140-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:09 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b36f23-b873-4be3-944c-444400db569b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[937bc19d-7af1-46f6-aac6-99541a6d1ff3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-quobyte-44e07203-db06-4e1b-962f-8a71fc0e1140" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-44e07203-db06-4e1b-962f-8a71fc0e1140" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dfd3de-e722-41d0-810b-890869fc79f8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:09 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:09 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:09 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 Jul 11 18:03:09 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Acquiring lock "cinder-3fc28b4f-de23-4af0-86a5-f92f848016c5-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "cinder-3fc28b4f-de23-4af0-86a5-f92f848016c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Acquiring lock "cinder-quobyte-3fc28b4f-de23-4af0-86a5-f92f848016c5" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "cinder-quobyte-3fc28b4f-de23-4af0-86a5-f92f848016c5" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5117f-30a4-4b3b-8e03-0fdd4be7fdcf]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:10 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:10 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:10 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:10 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140" returned: 0 in 0.881s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:03:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:10 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140 Jul 11 18:03:10 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:10 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 Jul 11 18:03:10 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:11 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 0 in 0.996s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:11 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:11 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:11 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-44e07203-db06-4e1b-962f-8a71fc0e1140" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-44e07203-db06-4e1b-962f-8a71fc0e1140" released by "delete_volume" :: held 1.832s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Created reservations ['de6bb6d0-da81-4800-883d-a76aa3b90a59', '06e3d1f3-8d02-4cac-a037-558937590bbf', '95f70d47-31e0-45df-91a2-776bc610ac83', 'b0176781-dc81-4c1b-9d72-c1099e13cf81'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:11 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:11 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-0050b429-e819-42db-b9f9-e273776da77a-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-0050b429-e819-42db-b9f9-e273776da77a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-quobyte-0050b429-e819-42db-b9f9-e273776da77a" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-0050b429-e819-42db-b9f9-e273776da77a" acquired by "delete_volume" :: waited 0.059s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb40e843-b95e-4235-8235-8c662f7d05c0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:13 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a Jul 11 18:03:13 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:13 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 1 in 2.032s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:03:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:13 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5 Jul 11 18:03:13 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:14 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 2.396s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:14 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Deleted volume successfully. Jul 11 18:03:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b4ec3d1c-bdd3-414f-bac3-3a76c03e2a6e tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-44e07203-db06-4e1b-962f-8a71fc0e1140-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:14 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a" returned: 0 in 1.714s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:14 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a Jul 11 18:03:14 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:15 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3fc28b4f-de23-4af0-86a5-f92f848016c5" returned: 0 in 1.931s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "cinder-quobyte-3fc28b4f-de23-4af0-86a5-f92f848016c5" released by "delete_volume" :: held 5.159s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:15 devstack cinder-volume[86932]: WARNING cinder.quota [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:03:15 devstack cinder-volume[86932]: WARNING cinder.quota [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Created reservations ['3342ba3d-153f-415a-af79-d9184f0b0ed5', '43684a46-7bd5-45eb-be86-642e9d09904e', 'c5588f7d-8a67-4d8b-8806-89a033117228', 'fe64988a-8e4c-496c-95ba-9a8f62fe192a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:15 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:15 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:16 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0050b429-e819-42db-b9f9-e273776da77a" returned: 0 in 1.691s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-0050b429-e819-42db-b9f9-e273776da77a" released by "delete_volume" :: held 3.568s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Created reservations ['2ad745ca-2bb8-4e2f-a2f1-95e807088d71', '7a8fc3cb-88be-4b72-8165-7e770e51fbf3', '0a024a33-3cab-4e26-a84c-f8577935dd86', 'a455f85e-b49b-481d-a87b-ee02c9df60d6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:16 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:16 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:17 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 2.055s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Deleted volume successfully. Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8c047496-03c0-4dad-abe4-a0d4d704ea00 tempest-VolumeAndVolumeTypeFromImageTest-2006560894 None] Lock "cinder-3fc28b4f-de23-4af0-86a5-f92f848016c5-delete_volume" released by "delete_volume" :: held 7.718s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:17 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515" returned: 0 in 7.330s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3aebf0-3080-4474-a7ca-9798e491cec3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-620243e1-3829-42ab-8fc6-b62e685c70d1-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-620243e1-3829-42ab-8fc6-b62e685c70d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "cinder-quobyte-620243e1-3829-42ab-8fc6-b62e685c70d1" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-620243e1-3829-42ab-8fc6-b62e685c70d1" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:18 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:18 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b126a8e-4917-4743-b391-2c4209671414]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:18 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.608s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:18 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Deleted volume successfully. Jul 11 18:03:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f0408580-cd38-4b3a-ad49-ecb57f967f6c tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-0050b429-e819-42db-b9f9-e273776da77a-delete_volume" released by "delete_volume" :: held 5.712s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:18 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 Jul 11 18:03:18 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:19 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:19 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1 Jul 11 18:03:19 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:19 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 1.438s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:03:19 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Converted 1024.00 MB image at 139.68 MB/s Jul 11 18:03:19 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 is being set with open permissions: ugo+rw Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:19 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 Jul 11 18:03:19 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:19 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-620243e1-3829-42ab-8fc6-b62e685c70d1" returned: 0 in 0.827s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-quobyte-620243e1-3829-42ab-8fc6-b62e685c70d1" released by "delete_volume" :: held 1.808s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Created reservations ['b240bbef-36c8-41a0-a6db-f2d9b5eb054f', '0a33b7cd-61df-4853-a917-770da0e25b91', 'fa2e0aff-ef27-47bb-9adb-9b6e3a8ce749', '2d71fbaf-060b-4d06-a8ae-d4b3410bf463'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:20 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:20 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:20 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515" returned: 0 in 0.792s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" released by "_copy_volume_from_snapshot" :: held 11.612s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93-40a48363-b2ae-4743-af00-2e9b7885a515" released by "_create_volume_from_snapshot" :: held 11.657s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.678s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132603d5-6564-4cd3-805f-21fa14298717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a48363-b2ae-4743-af00-2e9b7885a515', 'volume_size': 2, 'snapshot_id': '1bba2745-c72d-4869-9396-6b98d1c93d93'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aab10d4-7fd0-4db4-9ad2-f161d2087ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Volume volume-40a48363-b2ae-4743-af00-2e9b7885a515 (40a48363-b2ae-4743-af00-2e9b7885a515): created successfully Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aab10d4-7fd0-4db4-9ad2-f161d2087ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (b1a7509e-fb8c-4dac-8e9a-ab9fc0ba7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-039febcd-232e-4487-8e5a-e4e425d70024 tempest-VolumesSnapshotTestJSON-845996043 None] Created volume successfully. Jul 11 18:03:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a7fbb499-d49e-4eb5-9a1c-5de52d303dc1 tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-516506754: creating Jul 11 18:03:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-40a48363-b2ae-4743-af00-2e9b7885a515-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-40a48363-b2ae-4743-af00-2e9b7885a515-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:21 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.922s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a7fbb499-d49e-4eb5-9a1c-5de52d303dc1 tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-516506754: created successfully Jul 11 18:03:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Deleted volume successfully. Jul 11 18:03:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a7fbb499-d49e-4eb5-9a1c-5de52d303dc1 tempest-GroupSnapshotsTest-1404717089 None] Create group completed successfully. Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b24c7867-6c53-40c6-8fb3-e0639150d45b tempest-AttachVolumeNegativeTest-1823960188 None] Lock "cinder-620243e1-3829-42ab-8fc6-b62e685c70d1-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d99e2e-64ef-492a-8313-4e969efa1a55]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:21 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 Jul 11 18:03:21 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:22 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:22 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515 Jul 11 18:03:22 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:INSERT=23,cinder:DELETE=3 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (6499c224-3c98-497d-b944-e4f6eddc0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cef4e63-6201-4628-acc5-5a8a0ad46d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cef4e63-6201-4628-acc5-5a8a0ad46d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721671268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=042a9abb-a459-425c-979a-eeb14d977023,host='devstack@QuobyteHD#QuobyteHD',id=6e4b4f67-2463-4bb0-b44a-b16fbc212eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89a3fef0-a9c8-486f-aab6-73a3eff62c73),volume_type_id=89a3fef0-a9c8-486f-aab6-73a3eff62c73)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:22 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e9e487-974f-4678-9e07-d139bcf29c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e9e487-974f-4678-9e07-d139bcf29c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa52db-b151-4338-9b18-708b869432eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa52db-b151-4338-9b18-708b869432eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4b4f67-2463-4bb0-b44a-b16fbc212eb3', 'volume_name': 'volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6c917-94b9-414a-8596-cf150071878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6c917-94b9-414a-8596-cf150071878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a6cadf-793f-4afe-86ae-4a95a9ac5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Volume 6e4b4f67-2463-4bb0-b44a-b16fbc212eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3', 'volume_size': 1} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=042a9abb-a459-425c-979a-eeb14d977023,created_at=2026-07-11T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721671268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=042a9abb-a459-425c-979a-eeb14d977023,host='devstack@QuobyteHD#QuobyteHD',id=6e4b4f67-2463-4bb0-b44a-b16fbc212eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89a3fef0-a9c8-486f-aab6-73a3eff62c73),volume_type_id=89a3fef0-a9c8-486f-aab6-73a3eff62c73)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Creating volume 6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:23 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 1073741824 Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (db28db74-fedb-4fba-aef8-33cfba24aaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:23 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c404152b-49be-4e71-b92e-0ad247546740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-40a48363-b2ae-4743-af00-2e9b7885a515" returned: 0 in 0.984s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=75,cinder:SELECT=83,cinder:DELETE=10,cinder:INSERT=21 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c404152b-49be-4e71-b92e-0ad247546740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717828781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85376975-ebce-4f07-890e-7211d52f82dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0b2fa3-6df5-45f7-abd8-7ed1904e3e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0b2fa3-6df5-45f7-abd8-7ed1904e3e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07d58b7-5a11-4ec3-89bf-cdf4342dfbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07d58b7-5a11-4ec3-89bf-cdf4342dfbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85376975-ebce-4f07-890e-7211d52f82dc', 'volume_name': 'volume-85376975-ebce-4f07-890e-7211d52f82dc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851b9db-c1d5-4847-bdeb-3a68b446e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851b9db-c1d5-4847-bdeb-3a68b446e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339b7e58-cdd4-4bd2-8d71-bf2d9308cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Volume 85376975-ebce-4f07-890e-7211d52f82dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85376975-ebce-4f07-890e-7211d52f82dc', 'volume_size': 1} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-40a48363-b2ae-4743-af00-2e9b7885a515" released by "delete_volume" :: held 2.108s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['38309900-0587-411c-821b-a4587b0ec7ca', 'f3019301-5e96-4daa-b1d4-0033f2b2a27e', '62580305-40b6-45ed-9e88-9cd2a4a721d9', '0f99b169-6515-4e30-84b8-cf4dd6a667c1'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (613d77b1-2381-4386-923f-9b6591c8d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e2c897-72ea-4802-91d3-c48cca6c52b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e2c897-72ea-4802-91d3-c48cca6c52b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884343704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cec50b-a5b8-41af-8c54-a771136c0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cec50b-a5b8-41af-8c54-a771136c0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ddda4f-d1c9-4565-8686-6f3e70d4df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ddda4f-d1c9-4565-8686-6f3e70d4df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b', 'volume_name': 'volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb4a83a-1d58-4776-9219-c431c2a40048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb4a83a-1d58-4776-9219-c431c2a40048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf6ca8c-0b22-4437-9fc5-fc8ec713421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Volume 7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b', 'volume_size': 1} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:23 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:23 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-1bba2745-c72d-4869-9396-6b98d1c93d93-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-1bba2745-c72d-4869-9396-6b98d1c93d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Deleting offline snapshot 1bba2745-c72d-4869-9396-6b98d1c93d93 of volume 87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] snapshot_file for this snap is: volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1356a-235e-48f2-b62d-2cb88b689189]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (773bb34f-d286-4ce0-97f0-25252a715726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b45b26d-01f0-4ef3-bb6a-aeffbace68ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b45b26d-01f0-4ef3-bb6a-aeffbace68ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684995199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cfa365-5b70-4943-a459-095d5d4cda41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:24Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7a3dd1-dcea-4785-805a-37d57d948eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7a3dd1-dcea-4785-805a-37d57d948eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4218efce-9248-40b0-b34d-e72ac7b2b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4218efce-9248-40b0-b34d-e72ac7b2b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30cfa365-5b70-4943-a459-095d5d4cda41', 'volume_name': 'volume-30cfa365-5b70-4943-a459-095d5d4cda41', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43f6c25-c154-44a2-8dd4-b50d0f59da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43f6c25-c154-44a2-8dd4-b50d0f59da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9725d-1c64-4e4b-a570-b469480b1641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:24 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Volume 30cfa365-5b70-4943-a459-095d5d4cda41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30cfa365-5b70-4943-a459-095d5d4cda41', 'volume_size': 1} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 1073741824" returned: 0 in 1.266s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:24 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:24 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (f2b0dc66-03e0-4642-abd4-dd3ffbdb5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ae76a6-5a03-43b1-bfa0-5076f9bf0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ae76a6-5a03-43b1-bfa0-5076f9bf0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769436163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db597507-346d-439c-9866-ab0905edb898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:25Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b89c409-3579-4a64-8efb-e69b7fa48982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b89c409-3579-4a64-8efb-e69b7fa48982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcef8bef-e27e-4db7-baa5-eab15396bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcef8bef-e27e-4db7-baa5-eab15396bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db597507-346d-439c-9866-ab0905edb898', 'volume_name': 'volume-db597507-346d-439c-9866-ab0905edb898', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be768d6-397c-4442-b749-3e308db11d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be768d6-397c-4442-b749-3e308db11d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3079354-d80c-4d61-8daa-f78f02f3205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:24 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Volume db597507-346d-439c-9866-ab0905edb898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db597507-346d-439c-9866-ab0905edb898', 'volume_size': 1} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:24 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.345s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Deleted volume successfully. Jul 11 18:03:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bce68d12-4913-4e8b-abfd-b590f5ef9bbd tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-40a48363-b2ae-4743-af00-2e9b7885a515-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (ec3a154f-9f07-48ef-8ab2-1555fe70c2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:25 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c183f-9a3d-4f7a-875e-bd323ef6e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 1.079s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b36f23-b873-4be3-944c-444400db569b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c183f-9a3d-4f7a-875e-bd323ef6e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100529628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3a381-c149-4e4d-b88f-8cc246ce6d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:25Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aff314-17b2-41ae-bacd-3dedbc29ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aff314-17b2-41ae-bacd-3dedbc29ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a949fd-c242-4c66-82b5-7c2f7a10af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a949fd-c242-4c66-82b5-7c2f7a10af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece3a381-c149-4e4d-b88f-8cc246ce6d91', 'volume_name': 'volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f9a7b5-7e9e-4438-966b-0253c20a059e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f9a7b5-7e9e-4438-966b-0253c20a059e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91306a25-c87a-4a67-a3d2-f7d1340c9fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Volume ece3a381-c149-4e4d-b88f-8cc246ce6d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91', 'volume_size': 1} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8c9dd-8ec3-4719-a81f-bffc07be9794]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:25 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 0.917s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717828781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85376975-ebce-4f07-890e-7211d52f82dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Creating volume 85376975-ebce-4f07-890e-7211d52f82dc {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:25 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:25 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc 1073741824 Jul 11 18:03:25 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a6cadf-793f-4afe-86ae-4a95a9ac5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:25 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e045f0-d827-47c3-aebf-1be1f42a5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Volume volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 (6e4b4f67-2463-4bb0-b44a-b16fbc212eb3): created successfully Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e045f0-d827-47c3-aebf-1be1f42a5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (6499c224-3c98-497d-b944-e4f6eddc0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e4651870-75d2-467d-bdf5-bd1fbcf6ad2d tempest-GroupSnapshotsTest-1404717089 None] Created volume successfully. Jul 11 18:03:26 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 0.885s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:26 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:26 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:26 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc 1073741824" returned: 0 in 1.076s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:26 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc Jul 11 18:03:26 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] GroupSnapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: creating. Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Group snapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: creating. {{(pid=86932) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:03:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:27 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 0.990s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:27 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93 Jul 11 18:03:27 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:27 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc" returned: 0 in 0.897s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.752s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884343704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:23Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Creating volume 7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:27 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:27 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b 1073741824 Jul 11 18:03:27 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339b7e58-cdd4-4bd2-8d71-bf2d9308cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85376975-ebce-4f07-890e-7211d52f82dc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48329b21-355f-434f-9c5f-fa24e2353c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:27 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Volume volume-85376975-ebce-4f07-890e-7211d52f82dc (85376975-ebce-4f07-890e-7211d52f82dc): created successfully Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48329b21-355f-434f-9c5f-fa24e2353c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (db28db74-fedb-4fba-aef8-33cfba24aaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f814a83d-dee0-45c5-8dc6-a698066b9599 tempest-CreateVolumesFromImageTest-365539150 None] Created volume successfully. Jul 11 18:03:27 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b.1bba2745-c72d-4869-9396-6b98d1c93d93" returned: 0 in 0.716s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-1bba2745-c72d-4869-9396-6b98d1c93d93" released by "_delete_snapshot" :: held 3.857s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" released by "delete_snapshot" :: held 3.901s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['21359249-2db3-4bf6-b0bf-fcf0a4890de2', '461de3dd-7224-4757-b951-87b7c287a59c', '5d090ede-8070-43e2-9e24-a63e25a84a78', '19556fb2-fd5a-45bd-a2bb-cc5f5ea61a0e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Delete snapshot completed successfully. Jul 11 18:03:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e0849635-d0f4-4b1d-b6d7-09220e496b5b tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-1bba2745-c72d-4869-9396-6b98d1c93d93-delete_snapshot" released by "delete_snapshot" :: held 4.080s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:28 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b 1073741824" returned: 0 in 0.961s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:28 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b Jul 11 18:03:28 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-87b36f23-b873-4be3-944c-444400db569b-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-87b36f23-b873-4be3-944c-444400db569b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604cc78-a444-43be-81f6-276ebd1d6860]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:28 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:28 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:28 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" returned: 0 in 0.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.675s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684995199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cfa365-5b70-4943-a459-095d5d4cda41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:24Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Creating volume 30cfa365-5b70-4943-a459-095d5d4cda41 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:28 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:29 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 1073741824 Jul 11 18:03:29 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf6ca8c-0b22-4437-9fc5-fc8ec713421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b1a7cd-6a74-42ee-8656-ab878a9f2594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Volume volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b (7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b): created successfully Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b1a7cd-6a74-42ee-8656-ab878a9f2594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (613d77b1-2381-4386-923f-9b6591c8d92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3807e4d3-1866-4d57-b22c-a0b9fbd01c43 tempest-CreateVolumesFromImageTest-365539150 None] Created volume successfully. Jul 11 18:03:29 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 0.831s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:29 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b Jul 11 18:03:29 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:29 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 1073741824" returned: 0 in 0.956s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:30 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 Jul 11 18:03:30 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:30 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-87b36f23-b873-4be3-944c-444400db569b" returned: 0 in 0.693s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-87b36f23-b873-4be3-944c-444400db569b" released by "delete_volume" :: held 1.591s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['9a90654e-af47-4b32-8b12-0b364c595ad1', 'd5184ca4-680a-4fb1-bc8f-101471420e0e', '72505957-5057-4d92-85ce-f6e08fdd358e', '9c2d25b0-f943-41fe-946f-7d0a3345d53a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:30 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:30 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:30 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41" returned: 0 in 0.699s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.926s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769436163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db597507-346d-439c-9866-ab0905edb898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:25Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Creating volume db597507-346d-439c-9866-ab0905edb898 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9725d-1c64-4e4b-a570-b469480b1641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30cfa365-5b70-4943-a459-095d5d4cda41', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af52b5d3-1e59-4b47-ad78-0c0cf5efcfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:30 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 1073741824 Jul 11 18:03:30 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Volume volume-30cfa365-5b70-4943-a459-095d5d4cda41 (30cfa365-5b70-4943-a459-095d5d4cda41): created successfully Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af52b5d3-1e59-4b47-ad78-0c0cf5efcfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (773bb34f-d286-4ce0-97f0-25252a715726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3f010add-1666-40d9-ac0a-85cba2cdd1a2 tempest-CreateVolumesFromImageTest-365539150 None] Created volume successfully. Jul 11 18:03:30 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.693s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Deleted volume successfully. Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c3e88353-bec1-4eb4-a6e4-2485ea1dd574 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-87b36f23-b873-4be3-944c-444400db569b-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (214edd1e-965b-42ba-a29c-ac9dc72acb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f584c8ed-9630-49ba-b484-317c903c0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f584c8ed-9630-49ba-b484-317c903c0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1077157996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c0164-180e-40e7-b124-fe8dd598938d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:31Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa61fc4-154e-49a7-a3ad-015585b67637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa61fc4-154e-49a7-a3ad-015585b67637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ddfae9-9d53-40ae-ae51-6052d78ffe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ddfae9-9d53-40ae-ae51-6052d78ffe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2c0164-180e-40e7-b124-fe8dd598938d', 'volume_name': 'volume-af2c0164-180e-40e7-b124-fe8dd598938d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361e6694-3610-48f2-a7ad-9d8e0787139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361e6694-3610-48f2-a7ad-9d8e0787139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9657602-ee86-4fc8-aeeb-e44003922c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:31 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Volume af2c0164-180e-40e7-b124-fe8dd598938d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2c0164-180e-40e7-b124-fe8dd598938d', 'volume_size': 1} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:31 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 1073741824" returned: 0 in 1.061s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:31 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 Jul 11 18:03:31 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:32 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898" returned: 0 in 0.698s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.322s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100529628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3a381-c149-4e4d-b88f-8cc246ce6d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45f7091c06c4addbb31f08989c7fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:25Z,use_quota=True,user_id='d61d9ab5e47c4755873fc8f48bc8c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Creating volume ece3a381-c149-4e4d-b88f-8cc246ce6d91 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:32 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:32 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 1073741824 Jul 11 18:03:32 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3079354-d80c-4d61-8daa-f78f02f3205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db597507-346d-439c-9866-ab0905edb898', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d9544b-e651-410f-95c0-336a3208f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Volume volume-db597507-346d-439c-9866-ab0905edb898 (db597507-346d-439c-9866-ab0905edb898): created successfully Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d9544b-e651-410f-95c0-336a3208f93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (f2b0dc66-03e0-4642-abd4-dd3ffbdb5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-626a2aa0-f67b-452a-b369-703e6bee2ec0 tempest-CreateVolumesFromImageTest-365539150 None] Created volume successfully. Jul 11 18:03:33 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 1073741824" returned: 0 in 0.873s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:33 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 Jul 11 18:03:33 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:34 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91" returned: 0 in 0.636s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.127s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91306a25-c87a-4a67-a3d2-f7d1340c9fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aacc4a-9a92-4a0c-848c-20aa7a48d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Creating offline snapshot a167fbfb-aed1-4ac3-bbd6-65c310d02c7f of volume 6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cfff13-6a6c-4e3f-9b15-3d9785e0a20b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:34 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:34 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:34 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Volume volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 (ece3a381-c149-4e4d-b88f-8cc246ce6d91): created successfully Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aacc4a-9a92-4a0c-848c-20aa7a48d007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Flow 'volume_create_manager' (ec3a154f-9f07-48ef-8ab2-1555fe70c2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0feefd9f-f893-4807-a6a0-0e271ff9b0bd tempest-CreateVolumesFromImageTest-365539150 None] Created volume successfully. Jul 11 18:03:34 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:34 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:34 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.667s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:03:34 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 0.814s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-ece3a381-c149-4e4d-b88f-8cc246ce6d91-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:34 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f 1G Jul 11 18:03:34 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-ece3a381-c149-4e4d-b88f-8cc246ce6d91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-quobyte-ece3a381-c149-4e4d-b88f-8cc246ce6d91" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-ece3a381-c149-4e4d-b88f-8cc246ce6d91" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a720f1-d497-483e-86bf-49e6b10e9532]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:35 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 Jul 11 18:03:35 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:35 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f 1G" returned: 0 in 0.882s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:35 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:35 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:35 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91" returned: 0 in 0.873s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:35 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91 Jul 11 18:03:35 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:36 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:36 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:36 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:36 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:36 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ece3a381-c149-4e4d-b88f-8cc246ce6d91" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-ece3a381-c149-4e4d-b88f-8cc246ce6d91" released by "delete_volume" :: held 1.602s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Created reservations ['644945e9-383d-4b37-b964-dec8136addbf', '51661677-d1b7-4acb-b0d2-d33a492776c0', '3c833657-85b6-42df-a863-47841f7d9f91', '23db52b7-507c-4511-8fd2-9b27e20b37e4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:36 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:36 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-db597507-346d-439c-9866-ab0905edb898-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-db597507-346d-439c-9866-ab0905edb898-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:37 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.706s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-quobyte-db597507-346d-439c-9866-ab0905edb898" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:37 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info Jul 11 18:03:37 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-db597507-346d-439c-9866-ab0905edb898" acquired by "delete_volume" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95514030-8cf5-4b82-93c5-531cf5135e0f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:37 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 Jul 11 18:03:37 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:37 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.058s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Deleted volume successfully. Jul 11 18:03:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3d99899b-fae3-44e7-85bd-f64c958062e1 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-ece3a381-c149-4e4d-b88f-8cc246ce6d91-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:38 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info" returned: 0 in 0.844s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:38 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:38 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info Jul 11 18:03:38 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:38 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898" returned: 0 in 0.895s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:38 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898 Jul 11 18:03:38 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:38 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.info" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.827s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.346s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1077157996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c0164-180e-40e7-b124-fe8dd598938d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:31Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Creating volume af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:38 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:38 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d 1073741824 Jul 11 18:03:38 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:39 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-db597507-346d-439c-9866-ab0905edb898" returned: 0 in 0.695s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-db597507-346d-439c-9866-ab0905edb898" released by "delete_volume" :: held 1.658s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-19631ebe-9c8d-4418-b13c-18b6f8a316c0 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: created successfully Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Created reservations ['ea582927-6d5d-4aee-bbde-d4f3e1eababe', '2d680577-831c-4df1-aea6-e60e49923471', '26e1b573-91d2-4646-8224-87d9346413aa', 'c78e7702-dea5-4cef-b465-056c9d3efb0d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:39 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:39 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-30cfa365-5b70-4943-a459-095d5d4cda41-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-30cfa365-5b70-4943-a459-095d5d4cda41-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-quobyte-30cfa365-5b70-4943-a459-095d5d4cda41" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-30cfa365-5b70-4943-a459-095d5d4cda41" acquired by "delete_volume" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbe403-1105-4617-8c48-a23944144204]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:40 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 Jul 11 18:03:40 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:40 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d 1073741824" returned: 0 in 1.150s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:40 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:03:40 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:40 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.098s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Deleted volume successfully. Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8f92a3e6-4d2e-4c8d-b9fa-12bcf2b19812 tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-db597507-346d-439c-9866-ab0905edb898-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:40 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41" returned: 0 in 1.108s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:40 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:40 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41 Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.068s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f-93889667-a632-435f-a79d-cedd96933669" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:40 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9657602-ee86-4fc8-aeeb-e44003922c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2c0164-180e-40e7-b124-fe8dd598938d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39fe297-0f2f-4f7b-9b2d-ae2c3162dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f-93889667-a632-435f-a79d-cedd96933669" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Creating volume 93889667-a632-435f-a79d-cedd96933669 from snapshot a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Volume volume-af2c0164-180e-40e7-b124-fe8dd598938d (af2c0164-180e-40e7-b124-fe8dd598938d): created successfully Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39fe297-0f2f-4f7b-9b2d-ae2c3162dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (214edd1e-965b-42ba-a29c-ac9dc72acb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] snapshot: a167fbfb-aed1-4ac3-bbd6-65c310d02c7f, volume: 93889667-a632-435f-a79d-cedd96933669, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:03:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-56a9f0d6-2a0e-4854-ae61-a02ef70df229 tempest-VolumesSnapshotTestJSON-845996043 None] Created volume successfully. Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1669d-8d4a-43e4-b28d-ed2c48870c84]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:41 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:41 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:41 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-30cfa365-5b70-4943-a459-095d5d4cda41" returned: 0 in 0.811s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-30cfa365-5b70-4943-a459-095d5d4cda41" released by "delete_volume" :: held 1.997s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Created reservations ['b3d54839-f47f-44ce-8cbd-cdedfab09c8d', '1d361864-bef4-48a2-9ac0-5052a6908fd0', '9ff6fce4-9187-4ae0-98fa-669645d3c260', '5f31f7f3-d4e2-41e0-b9c6-78a46ee9b75c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:41 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:41 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-quobyte-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7c5f4-f5b9-49d1-b2bf-3d0d7fe1b046]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:42 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.966s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e82c80-e2f1-454c-abf0-807b757f7920]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:42 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b Jul 11 18:03:42 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:42 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:42 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:42 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.852s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Deleted volume successfully. Jul 11 18:03:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-35cede77-47b9-49de-996a-c52e8d502a3b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-30cfa365-5b70-4943-a459-095d5d4cda41-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:43 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" returned: 0 in 0.939s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:43 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 0.927s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:43 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b Jul 11 18:03:43 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:43 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 Jul 11 18:03:43 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:43 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" returned: 0 in 0.726s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b" released by "delete_volume" :: held 1.720s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Created reservations ['f53822e7-3770-4f75-a541-084c4d3f83bf', '83e39c47-8459-4aac-9f64-00243927f52b', '934c8db3-c24b-4525-8d9d-ea1cfbea9c50', '196f0481-9bf6-4ed2-b6a3-4ced7ac5e6e9'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:43 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:43 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-85376975-ebce-4f07-890e-7211d52f82dc-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-85376975-ebce-4f07-890e-7211d52f82dc-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "cinder-quobyte-85376975-ebce-4f07-890e-7211d52f82dc" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-85376975-ebce-4f07-890e-7211d52f82dc" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8361853-40d1-4426-87e6-406636259b2a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:45 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc Jul 11 18:03:45 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:45 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.937s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:45 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Deleted volume successfully. Jul 11 18:03:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1fc292c6-2699-4fa5-8962-b2494a92093b tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-7d6f97b9-b9bb-4955-a56d-29eda2b9ad4b-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:47 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc" returned: 0 in 2.653s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:47 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc Jul 11 18:03:47 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:48 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669" returned: 0 in 5.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4813525-f14d-442e-afda-d11042853144]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:48 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-85376975-ebce-4f07-890e-7211d52f82dc" returned: 0 in 1.404s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-quobyte-85376975-ebce-4f07-890e-7211d52f82dc" released by "delete_volume" :: held 4.190s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:48 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:48 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:48 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Created reservations ['018547a7-274d-4f76-8e04-6f7db19fb4e1', 'f7a5d8e0-8a1c-4615-be78-24d184308a03', '86e10442-4eca-4b5a-a451-860116e89f63', 'e404c9f8-3d13-42f7-af48-55da07e71e32'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:49 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:49 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:49 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Deleted volume successfully. Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2cfc4d4b-defd-4fee-a446-57acd97fe6fc tempest-CreateVolumesFromImageTest-365539150 None] Lock "cinder-85376975-ebce-4f07-890e-7211d52f82dc-delete_volume" released by "delete_volume" :: held 5.337s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:49 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 1.125s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:03:49 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Converted 1024.00 MB image at 177.79 MB/s Jul 11 18:03:49 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:03:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:49 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 Jul 11 18:03:49 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:50 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669" returned: 0 in 0.719s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" released by "_copy_volume_from_snapshot" :: held 9.669s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f-93889667-a632-435f-a79d-cedd96933669" released by "_create_volume_from_snapshot" :: held 9.728s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.771s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.284s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Creating offline snapshot 292d0f0a-95fb-4cee-bfd1-23463c1762ee of volume af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490cddb-147d-4384-9a3f-fdb66bba0f0e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-df2669ad-df54-44e6-9820-93eea8702d79 tempest-GroupSnapshotsTest-1404717089 None] Create group from source-snapshot-4e9b0d34-0422-47bd-ba5a-641aaf15cc60 completed successfully. Jul 11 18:03:50 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:03:50 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50bdc9b-e0be-46f9-b06c-12ed43153535]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:51 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 Jul 11 18:03:51 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:51 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 1.011s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:51 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee 1G Jul 11 18:03:51 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:52 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669" returned: 0 in 0.955s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:52 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669 Jul 11 18:03:52 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:52 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee 1G" returned: 0 in 1.066s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2c0164-180e-40e7-b124-fe8dd598938d -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:52 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2c0164-180e-40e7-b124-fe8dd598938d -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:03:52 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:53 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93889667-a632-435f-a79d-cedd96933669" returned: 0 in 0.891s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-93889667-a632-435f-a79d-cedd96933669" released by "delete_volume" :: held 1.904s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['4fa4004e-317d-46c4-a59d-9bd295b2eb11'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:53 devstack cinder-volume[86932]: WARNING cinder.quota [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-957419094 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-957419094, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:03:53 devstack cinder-volume[86932]: WARNING cinder.quota [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-957419094 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-957419094, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (19fee55a-3f60-4ccc-a05f-636e148a40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57015620-5cc9-4833-bdcf-7e8a42c4b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['215f3f0c-49e6-49b6-8f0d-6c46c7b73e3e', '531031a3-c7ed-4650-8973-41dd05bb2eda', '03eb93e4-6adb-4d7e-96ca-f68d7d0fdaa5', '825c8322-41d3-402d-8004-806f52a06cdd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57015620-5cc9-4833-bdcf-7e8a42c4b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670776482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c8a632-87ff-4cbc-b416-57bfd898fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:53Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b43f74-5813-4501-8db7-81cf81d952eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b43f74-5813-4501-8db7-81cf81d952eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340e8797-e44c-40be-a4f0-47ecead03660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340e8797-e44c-40be-a4f0-47ecead03660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c8a632-87ff-4cbc-b416-57bfd898fd1a', 'volume_name': 'volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb09576-71c4-482e-a111-30be78002b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb09576-71c4-482e-a111-30be78002b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b25d4d-3926-4a9c-9f16-41aa1387b1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume 66c8a632-87ff-4cbc-b416-57bfd898fd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a', 'volume_size': 1} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:53 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2c0164-180e-40e7-b124-fe8dd598938d -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:53 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee is being set with open permissions: ugo+rw Jul 11 18:03:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:53 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:03:53 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:53 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:03:53 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: deleting Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: deleting {{(pid=86932) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Deleting offline snapshot a167fbfb-aed1-4ac3-bbd6-65c310d02c7f of volume 6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] snapshot_file for this snap is: volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548cf7a-f095-4cc8-b05d-267fce2ec905]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:54 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:54 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:54 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:03:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-17869725-9e4c-4e00-a143-c5aa59c06c35 tempest-GroupSnapshotsTest-1404717089 None] Delete group completed successfully. Jul 11 18:03:54 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.872s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:54 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info Jul 11 18:03:54 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:55 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f774c-7963-419f-9a77-a638fbc8ee94]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:55 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:55 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:55 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info" returned: 0 in 0.679s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:55 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info is being set with open permissions: ugo+rw Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:55 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info Jul 11 18:03:55 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:55 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 0.817s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:55 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:55 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:56 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.info" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670776482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c8a632-87ff-4cbc-b416-57bfd898fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:53Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume 66c8a632-87ff-4cbc-b416-57bfd898fd1a {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:56 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:56 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a 1073741824 Jul 11 18:03:56 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1c0d96f8-d190-40e9-b417-533378a76ac7 tempest-VolumesSnapshotTestJSON-845996043 None] Create snapshot completed successfully Jul 11 18:03:56 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:56 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f Jul 11 18:03:56 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:57 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a 1073741824" returned: 0 in 1.038s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:57 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a Jul 11 18:03:57 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (d573d74a-0ad8-40f7-a02d-bf09ee19c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4e1b1f-480e-439d-8d50-a908c5cc38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4e1b1f-480e-439d-8d50-a908c5cc38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-833300958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c3025e-1076-449f-995e-6c0525118172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa24918388244474b46a6b17695ce17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=292d0f0a-95fb-4cee-bfd1-23463c1762ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:57Z,use_quota=True,user_id='92b2801167f746fda97f4c7fcd5ed35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8be8f-df01-44e5-9106-a15a3fba245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8be8f-df01-44e5-9106-a15a3fba245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b37c0eb-9371-4303-8f5d-c345ca298a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b37c0eb-9371-4303-8f5d-c345ca298a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7c3025e-1076-449f-995e-6c0525118172', 'volume_name': 'volume-a7c3025e-1076-449f-995e-6c0525118172', 'volume_size': 1, 'snapshot_id': '292d0f0a-95fb-4cee-bfd1-23463c1762ee'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a086de-5ec6-4908-884e-428d32e22e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a086de-5ec6-4908-884e-428d32e22e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87cf83b-a61f-4a6b-8add-211085973093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Volume a7c3025e-1076-449f-995e-6c0525118172: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7c3025e-1076-449f-995e-6c0525118172', 'volume_size': 1, 'snapshot_id': '292d0f0a-95fb-4cee-bfd1-23463c1762ee'} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:57 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3.a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" returned: 0 in 0.823s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-a167fbfb-aed1-4ac3-bbd6-65c310d02c7f" released by "_delete_snapshot" :: held 3.531s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" released by "delete_snapshot" :: held 3.574s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:03:57 devstack cinder-volume[86932]: WARNING cinder.quota [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-957419094 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-957419094, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['d74043d7-89ff-4c14-90a1-615938c4fc12', '16fa3650-a153-4023-abd6-fd61b2338944', 'e0cffc82-7a94-42f0-9221-1ac524d39bbd', '9abac99f-e932-4ef6-ab32-f49da54e0bd1'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:03:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0ec87fd9-fcc0-4e18-abe2-be925ea8e494 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 4e9b0d34-0422-47bd-ba5a-641aaf15cc60: deleted successfully Jul 11 18:03:57 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a" returned: 0 in 0.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.459s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee-a7c3025e-1076-449f-995e-6c0525118172" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b25d4d-3926-4a9c-9f16-41aa1387b1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed71704-d827-456d-b5a9-e1b96dd7d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee-a7c3025e-1076-449f-995e-6c0525118172" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Creating volume a7c3025e-1076-449f-995e-6c0525118172 from snapshot 292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a (66c8a632-87ff-4cbc-b416-57bfd898fd1a): created successfully Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed71704-d827-456d-b5a9-e1b96dd7d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (19fee55a-3f60-4ccc-a05f-636e148a40ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] snapshot: 292d0f0a-95fb-4cee-bfd1-23463c1762ee, volume: a7c3025e-1076-449f-995e-6c0525118172, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:03:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5deb29ca-6629-40cc-90b5-b52321fe6355 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda36cb-548b-4405-afea-5540100b1ffd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:58 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:03:58 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:03:58 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af2c0164-180e-40e7-b124-fe8dd598938d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21214cf-7e87-416b-8d95-a4e66c1a1539]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed03f9-f4d7-4a10-8433-4821a080bdad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:03:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:59 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:03:59 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:59 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:03:59 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (b1bbff3a-c878-48fd-9514-ee4ee8bfec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af11a6a8-f9c2-4015-84e3-7534b71438cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af11a6a8-f9c2-4015-84e3-7534b71438cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-560365001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23fa2e0-dc17-4562-8a1a-f33b7d7612e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:59Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554b2bd2-cdb9-4030-9fab-f64ed7c70d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554b2bd2-cdb9-4030-9fab-f64ed7c70d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e8c2bc-9575-4d31-8d92-6fb638290851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e8c2bc-9575-4d31-8d92-6fb638290851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23fa2e0-dc17-4562-8a1a-f33b7d7612e9', 'volume_name': 'volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c894f906-96d1-48cd-9435-e0ff410ff997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c894f906-96d1-48cd-9435-e0ff410ff997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dae8c2d-834c-4602-a89c-d713c04f8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume b23fa2e0-dc17-4562-8a1a-f33b7d7612e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9', 'volume_size': 1} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (bde49e1b-c660-4324-908e-db39adbb6533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab04e6-d913-42ce-95f6-66276c8e1bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab04e6-d913-42ce-95f6-66276c8e1bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128693075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e98d07e-6a96-411b-87ef-8dc1b0c89ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:00Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dd525b-f9d0-4a5e-8fbb-09accde17e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dd525b-f9d0-4a5e-8fbb-09accde17e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4c4c85-e01b-44c6-b7b0-c25726dc0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4c4c85-e01b-44c6-b7b0-c25726dc0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e98d07e-6a96-411b-87ef-8dc1b0c89ce6', 'volume_name': 'volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea637f99-463d-4f0b-aacc-86c3954dba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea637f99-463d-4f0b-aacc-86c3954dba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb05e7a8-5295-4831-b0ce-9f52e878657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:03:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume 9e98d07e-6a96-411b-87ef-8dc1b0c89ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6', 'volume_size': 1} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:03:59 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.954s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:03:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:03:59 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 Jul 11 18:03:59 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:00 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 1.142s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:00 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3 Jul 11 18:04:00 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (2873f6ea-1d8b-428f-a89b-51b24d509c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd9ce6c-9d61-4aee-aade-475f52f49bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd9ce6c-9d61-4aee-aade-475f52f49bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2016273722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cb2509-2977-497c-b1d4-86acecfe4cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:00Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9902e506-69ac-4537-b0a8-a15e2414c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9902e506-69ac-4537-b0a8-a15e2414c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e01e7-f703-4e68-9291-b7fa13a7fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e01e7-f703-4e68-9291-b7fa13a7fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cb2509-2977-497c-b1d4-86acecfe4cd5', 'volume_name': 'volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa2b032-49ea-455c-9f91-537f694e201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa2b032-49ea-455c-9f91-537f694e201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f3048d-323f-4064-8603-e3795a26e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:00 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume d2cb2509-2977-497c-b1d4-86acecfe4cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5', 'volume_size': 1} Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:00 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" returned: 0 in 0.901s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-6e4b4f67-2463-4bb0-b44a-b16fbc212eb3" released by "delete_volume" :: held 2.131s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['ea42cfec-e1a8-47d7-b9d9-ba1c662bbd8a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:01 devstack cinder-volume[86932]: WARNING cinder.db.api [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-957419094'] Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (452d3ae4-bc57-461c-aa51-e60deb4d323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b06dfbe-0ff8-4dfe-a1d3-38387d1f9db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['11698d34-798a-4e09-ab26-988f848170a7', '3b40bf7d-96f8-406d-b789-840ef8d1698f', 'fdd20085-5e13-40a9-9413-e25a89b2267a', '8b9ab967-aff0-465f-a406-f983003f3007'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Flow 'volume_create_manager' (88f21f60-19e9-4f38-9cd3-9a0cecea880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9066a759-d171-478a-b7d1-709ccccd06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b06dfbe-0ff8-4dfe-a1d3-38387d1f9db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056491055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c215c4-0c0d-4c8f-87d6-697dda2dc758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10a9d4a-0e01-40e6-8ec7-cb0bbb5a3707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10a9d4a-0e01-40e6-8ec7-cb0bbb5a3707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca67d0d-2223-4f5f-b1fe-85cfb133d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca67d0d-2223-4f5f-b1fe-85cfb133d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c215c4-0c0d-4c8f-87d6-697dda2dc758', 'volume_name': 'volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88d3d96-5b89-4097-b063-23fbfbf50645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88d3d96-5b89-4097-b063-23fbfbf50645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbb2a15-1541-4ebe-99ba-49145266fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume 75c215c4-0c0d-4c8f-87d6-697dda2dc758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758', 'volume_size': 1} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9066a759-d171-478a-b7d1-709ccccd06f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1996994219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630d877a-2606-425c-a50e-10d5ce08821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80de94ff21c3434096454a5160f429b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='9596a7335d1641eb8741da12bd495fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953c64ff-b004-4960-bba1-a0e2d65f42cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953c64ff-b004-4960-bba1-a0e2d65f42cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f678e7-275e-43fe-ad5d-a1668090fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f678e7-275e-43fe-ad5d-a1668090fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630d877a-2606-425c-a50e-10d5ce08821f', 'volume_name': 'volume-630d877a-2606-425c-a50e-10d5ce08821f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee32bfb-c409-4ba1-8c62-96db89e36e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee32bfb-c409-4ba1-8c62-96db89e36e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd31f73c-d9d0-4c45-ad22-68040ac8e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Volume 630d877a-2606-425c-a50e-10d5ce08821f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630d877a-2606-425c-a50e-10d5ce08821f', 'volume_size': 1} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (fa51f1c6-f825-4e4e-8b47-265c3427f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71846366-e5d6-4e6b-a13a-3bdd7fd6c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71846366-e5d6-4e6b-a13a-3bdd7fd6c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726983497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bce6a81-a264-46d0-a35a-a700c40c0fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a1f08-4f1c-4cb7-bd3a-ba841ce1b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a1f08-4f1c-4cb7-bd3a-ba841ce1b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32adcb6-a9ab-4498-b63e-d000f4ddf7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32adcb6-a9ab-4498-b63e-d000f4ddf7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bce6a81-a264-46d0-a35a-a700c40c0fb6', 'volume_name': 'volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5aa5e9-5b8d-47e9-9e44-b60a60529c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5aa5e9-5b8d-47e9-9e44-b60a60529c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b002e-5f57-45c5-9ae6-b244ed29fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume 2bce6a81-a264-46d0-a35a-a700c40c0fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6', 'volume_size': 1} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:01 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:01 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:03 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.265s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:03 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e2ee0916-907f-4455-8a0c-d2d80fb60392 tempest-GroupSnapshotsTest-1404717089 None] Delete group completed successfully. Jul 11 18:04:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-53a317a2-c712-4f53-8730-b622a021756f tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-943754016: creating Jul 11 18:04:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-53a317a2-c712-4f53-8730-b622a021756f tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-943754016: created successfully Jul 11 18:04:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-53a317a2-c712-4f53-8730-b622a021756f tempest-GroupSnapshotsTest-1404717089 None] Create group completed successfully. Jul 11 18:04:05 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172" returned: 0 in 5.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2b898-788d-4074-8ed9-82063ad12680]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:05 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:04:05 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (931e7f06-5da5-4692-9b10-951c527f176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33c6878-f357-4c00-b386-5ba535e43940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33c6878-f357-4c00-b386-5ba535e43940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938265592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3641088a-f258-4360-81eb-077d33fa2bd7,host='devstack@QuobyteHD#QuobyteHD',id=e881b092-f880-410b-a8ab-d30079dab4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:06Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56fa04e2-6638-4b25-9883-4b3372584686),volume_type_id=56fa04e2-6638-4b25-9883-4b3372584686)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd19406-015a-46e5-8891-80cc8b4caffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd19406-015a-46e5-8891-80cc8b4caffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f361102-6b7c-4e1f-a385-bc12c801bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f361102-6b7c-4e1f-a385-bc12c801bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e881b092-f880-410b-a8ab-d30079dab4ea', 'volume_name': 'volume-e881b092-f880-410b-a8ab-d30079dab4ea', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5546cd14-0531-4523-810b-eb38d308e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5546cd14-0531-4523-810b-eb38d308e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bb7d06-a6f5-42b1-9f45-ad35fced40df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:06 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Volume e881b092-f880-410b-a8ab-d30079dab4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e881b092-f880-410b-a8ab-d30079dab4ea', 'volume_size': 1} Jul 11 18:04:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:06 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.962s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:06 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:04:06 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Converted 1024.00 MB image at 176.85 MB/s Jul 11 18:04:06 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 is being set with open permissions: ugo+rw Jul 11 18:04:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:06 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 Jul 11 18:04:06 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:07 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172" returned: 0 in 0.637s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" released by "_copy_volume_from_snapshot" :: held 9.378s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee-a7c3025e-1076-449f-995e-6c0525118172" released by "_create_volume_from_snapshot" :: held 9.424s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.456s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.785s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-560365001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23fa2e0-dc17-4562-8a1a-f33b7d7612e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:03:59Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:07 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:07 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 1073741824 Jul 11 18:04:07 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87cf83b-a61f-4a6b-8add-211085973093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c3025e-1076-449f-995e-6c0525118172', 'volume_size': 1, 'snapshot_id': '292d0f0a-95fb-4cee-bfd1-23463c1762ee'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000dc5f2-ad69-4fbf-8f27-eb41d7fa3227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Volume volume-a7c3025e-1076-449f-995e-6c0525118172 (a7c3025e-1076-449f-995e-6c0525118172): created successfully Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000dc5f2-ad69-4fbf-8f27-eb41d7fa3227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Flow 'volume_create_manager' (d573d74a-0ad8-40f7-a02d-bf09ee19c3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-656ff7f7-0536-4b05-93d7-f24aca389b0a tempest-VolumesSnapshotTestJSON-845996043 None] Created volume successfully. Jul 11 18:04:08 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 1073741824" returned: 0 in 0.810s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:08 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 Jul 11 18:04:08 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-a7c3025e-1076-449f-995e-6c0525118172-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-a7c3025e-1076-449f-995e-6c0525118172-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[81299663-805b-4584-9690-3c6668122e16]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:08 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 Jul 11 18:04:08 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:08 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" returned: 0 in 0.671s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.995s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128693075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e98d07e-6a96-411b-87ef-8dc1b0c89ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:00Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume 9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:08 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dae8c2d-834c-4602-a89c-d713c04f8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:08 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 1073741824 Jul 11 18:04:08 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38e1b2-ec07-4315-9591-4d3e87f2ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 (b23fa2e0-dc17-4562-8a1a-f33b7d7612e9): created successfully Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38e1b2-ec07-4315-9591-4d3e87f2ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (b1bbff3a-c878-48fd-9514-ee4ee8bfec22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b31f8b17-7bfc-4514-950a-c179d820dcae tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:04:09 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172" returned: 0 in 0.772s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:09 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172 Jul 11 18:04:09 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:09 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 1073741824" returned: 0 in 0.831s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:09 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 Jul 11 18:04:09 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:10 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7c3025e-1076-449f-995e-6c0525118172" returned: 0 in 0.680s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-a7c3025e-1076-449f-995e-6c0525118172" released by "delete_volume" :: held 1.496s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['8d86abba-cf23-4370-9bac-ebbcde0ab7f6', '4ffaa7bc-5ed1-4de0-b6dc-7cb6ccd5351e', '050cdb0f-1c22-4565-8057-9aeeda12efb1', '4a9ec343-7861-4e67-bd28-ea8db3cc61c5'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:10 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:10 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:10 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.782s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2016273722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cb2509-2977-497c-b1d4-86acecfe4cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:00Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume d2cb2509-2977-497c-b1d4-86acecfe4cd5 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:10 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb05e7a8-5295-4831-b0ce-9f52e878657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:10 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 1073741824 Jul 11 18:04:10 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2a4960-9311-45f0-99b1-295f85fd0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 (9e98d07e-6a96-411b-87ef-8dc1b0c89ce6): created successfully Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2a4960-9311-45f0-99b1-295f85fd0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (bde49e1b-c660-4324-908e-db39adbb6533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b29abac3-1475-4ed1-9cdc-ed1ad0842a21 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-292d0f0a-95fb-4cee-bfd1-23463c1762ee-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-292d0f0a-95fb-4cee-bfd1-23463c1762ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Deleting offline snapshot 292d0f0a-95fb-4cee-bfd1-23463c1762ee of volume af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] snapshot_file for this snap is: volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:04:10 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.683s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49469f78-73fd-4592-97b4-e311dc016d23]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Deleted volume successfully. Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3e9eb691-6585-4e40-a46b-e5a4a57a5744 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-a7c3025e-1076-449f-995e-6c0525118172-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:11 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:04:11 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:11 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 1073741824" returned: 0 in 0.837s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:11 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 Jul 11 18:04:11 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:11 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.822s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af2c0164-180e-40e7-b124-fe8dd598938d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fe802-4988-4b7c-9332-3fe35056d365]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:11 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:04:11 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:12 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.660s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056491055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c215c4-0c0d-4c8f-87d6-697dda2dc758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume 75c215c4-0c0d-4c8f-87d6-697dda2dc758 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:12 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f3048d-323f-4064-8603-e3795a26e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633a2144-cd20-4fde-8688-6639c9a00ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:12 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 1073741824 Jul 11 18:04:12 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 (d2cb2509-2977-497c-b1d4-86acecfe4cd5): created successfully Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633a2144-cd20-4fde-8688-6639c9a00ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (2873f6ea-1d8b-428f-a89b-51b24d509c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-dab49297-a4c0-4b21-b1ea-7874ce29a9ed tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:04:12 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.784s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:12 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:04:12 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:12 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 1073741824" returned: 0 in 0.897s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:12 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 Jul 11 18:04:12 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:13 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.827s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:13 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee Jul 11 18:04:13 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:13 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.227s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1996994219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630d877a-2606-425c-a50e-10d5ce08821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80de94ff21c3434096454a5160f429b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='9596a7335d1641eb8741da12bd495fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Creating volume 630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:13 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbb2a15-1541-4ebe-99ba-49145266fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:13 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f 1073741824 Jul 11 18:04:13 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e693cc-22ef-4fa9-a69e-f576a9af50de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:13 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 (75c215c4-0c0d-4c8f-87d6-697dda2dc758): created successfully Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e693cc-22ef-4fa9-a69e-f576a9af50de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (452d3ae4-bc57-461c-aa51-e60deb4d323f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a6d272dc-34f3-47f9-bc4f-a1b4edc69d8a tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:04:14 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d.292d0f0a-95fb-4cee-bfd1-23463c1762ee" returned: 0 in 0.679s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-292d0f0a-95fb-4cee-bfd1-23463c1762ee" released by "_delete_snapshot" :: held 3.220s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" released by "delete_snapshot" :: held 3.255s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['da67bf39-94d2-4ca5-a7c3-7f9fb607e5f1', 'e4555bf3-7cf5-4828-8682-b15018406d6a', '7cae7f30-4ca3-4bda-bbab-7544eb90f533', '8fac9800-7b3a-4392-9f9e-d0ebdce124cc'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Delete snapshot completed successfully. Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43008408-d5a9-45df-a9fc-a2971b0af1e9 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-292d0f0a-95fb-4cee-bfd1-23463c1762ee-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:14 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f 1073741824" returned: 0 in 0.877s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:14 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f Jul 11 18:04:14 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-af2c0164-180e-40e7-b124-fe8dd598938d-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-af2c0164-180e-40e7-b124-fe8dd598938d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:15 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.618s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726983497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bce6a81-a264-46d0-a35a-a700c40c0fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c0a247455b4ab2ac6d5213e83c6147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:01Z,use_quota=True,user_id='0bf2301275954c04a34796058a3b3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Creating volume 2bce6a81-a264-46d0-a35a-a700c40c0fb6 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:15 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd31f73c-d9d0-4c45-ad22-68040ac8e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630d877a-2606-425c-a50e-10d5ce08821f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:15 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 1073741824 Jul 11 18:04:15 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6894be3-aabb-4ff3-b5c7-aacc62bb1183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" acquired by "delete_volume" :: waited 0.062s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:15 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Volume volume-630d877a-2606-425c-a50e-10d5ce08821f (630d877a-2606-425c-a50e-10d5ce08821f): created successfully Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6894be3-aabb-4ff3-b5c7-aacc62bb1183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Flow 'volume_create_manager' (88f21f60-19e9-4f38-9cd3-9a0cecea880c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1aeab-0a02-4376-82c3-c518e53bc772]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fb0b85e8-162a-47a0-b463-63c3b8aee6d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Created volume successfully. Jul 11 18:04:15 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:04:15 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:16 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 1073741824" returned: 0 in 0.866s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:16 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:16 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 Jul 11 18:04:16 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:16 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d Jul 11 18:04:16 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:16 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6" returned: 0 in 0.694s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.870s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3641088a-f258-4360-81eb-077d33fa2bd7,created_at=2026-07-11T16:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938265592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3641088a-f258-4360-81eb-077d33fa2bd7,host='devstack@QuobyteHD#QuobyteHD',id=e881b092-f880-410b-a8ab-d30079dab4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:06Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56fa04e2-6638-4b25-9883-4b3372584686),volume_type_id=56fa04e2-6638-4b25-9883-4b3372584686)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Creating volume e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:16 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:16 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:16 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea 1073741824 Jul 11 18:04:16 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b002e-5f57-45c5-9ae6-b244ed29fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ced1c74-b070-420e-b310-6cf00556a027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-af2c0164-180e-40e7-b124-fe8dd598938d" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Volume volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 (2bce6a81-a264-46d0-a35a-a700c40c0fb6): created successfully Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ced1c74-b070-420e-b310-6cf00556a027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Flow 'volume_create_manager' (fa51f1c6-f825-4e4e-8b47-265c3427f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-af2c0164-180e-40e7-b124-fe8dd598938d" released by "delete_volume" :: held 1.658s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-44efae3d-2c97-48dc-9727-7a24d681a509 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created volume successfully. Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['c1f561cf-1092-4654-aa67-f2dd8e96957f', '89560801-41c7-4c52-a564-fbc69b155f8e', '55872941-5725-4555-8bc0-0f4b0534ce9a', 'bd007eff-a209-4999-a574-7102b48ba714'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:17 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:17 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-78123621-9076-42fe-8233-fcb041d624ff-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-78123621-9076-42fe-8233-fcb041d624ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1072a891-dcbf-4a21-9e3f-94734a158f1b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-2bce6a81-a264-46d0-a35a-a700c40c0fb6-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:17 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.739s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-2bce6a81-a264-46d0-a35a-a700c40c0fb6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Deleted volume successfully. Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b6310f45-e046-48f7-ad64-a4888dd9776f tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-af2c0164-180e-40e7-b124-fe8dd598938d-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-2bce6a81-a264-46d0-a35a-a700c40c0fb6" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:17 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff Jul 11 18:04:17 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-2bce6a81-a264-46d0-a35a-a700c40c0fb6" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:17 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea 1073741824" returned: 0 in 1.042s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f68747-ab19-4654-93ea-df3349d5ccde]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:17 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea Jul 11 18:04:17 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:18 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 Jul 11 18:04:18 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:18 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:18 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff Jul 11 18:04:18 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:18 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea" returned: 0 in 0.652s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.219s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Creating offline snapshot 25f11333-5185-4b70-a4af-082076439465 of volume 630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bb7d06-a6f5-42b1-9f45-ad35fced40df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e881b092-f880-410b-a8ab-d30079dab4ea', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7a6b04-14a2-4e7b-aa50-a58cdfed1c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a40767-2bae-4164-a3b9-20baf8aa105b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Volume volume-e881b092-f880-410b-a8ab-d30079dab4ea (e881b092-f880-410b-a8ab-d30079dab4ea): created successfully Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7a6b04-14a2-4e7b-aa50-a58cdfed1c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:18 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (931e7f06-5da5-4692-9b10-951c527f176a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6" returned: 0 in 0.800s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:18 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-525fd36d-9b16-4509-8e01-8dd63a19fce8 tempest-GroupSnapshotsTest-1404717089 None] Created volume successfully. Jul 11 18:04:18 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6 Jul 11 18:04:18 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:18 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f Jul 11 18:04:18 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:19 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-78123621-9076-42fe-8233-fcb041d624ff" returned: 0 in 0.711s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-quobyte-78123621-9076-42fe-8233-fcb041d624ff" released by "delete_volume" :: held 1.607s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Created reservations ['b1549716-0ffb-4440-b9fc-7b74e36f380d', '033f0c84-06e1-48aa-a2de-8e9b735d0c4c', '8be28116-1eeb-4045-99c5-2159d7d8c0c3', '587dcfbb-c42c-4b76-b90f-0762c81bff6e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:19 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2bce6a81-a264-46d0-a35a-a700c40c0fb6" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:19 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:19 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-2bce6a81-a264-46d0-a35a-a700c40c0fb6" released by "delete_volume" :: held 1.569s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:19 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f" returned: 0 in 0.861s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['64c6073e-95b0-43e8-824a-e0ce51db3cad', '0ce19441-20a0-4d7d-89bc-5ad132e657aa', '369d10a5-5e41-43b3-a6f3-6fe1bbf853e2', '8dcf08b9-5778-427f-9ead-c86b60940b7e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:19 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 1G Jul 11 18:04:19 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:19 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:19 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-75c215c4-0c0d-4c8f-87d6-697dda2dc758-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-75c215c4-0c0d-4c8f-87d6-697dda2dc758-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-75c215c4-0c0d-4c8f-87d6-697dda2dc758" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:20 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.726s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Deleted volume successfully. Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-75c215c4-0c0d-4c8f-87d6-697dda2dc758" acquired by "delete_volume" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e537f6c1-f2f4-42bb-9724-66666da62744]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c6dbdf67-7c3b-4b47-9aa7-959d2720e911 tempest-VolumesSnapshotTestJSON-845996043 None] Lock "cinder-78123621-9076-42fe-8233-fcb041d624ff-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:20 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 Jul 11 18:04:20 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:20 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (da821ad5-7883-4bee-bbb4-b080b21c62fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02abe186-3d97-447f-9fc7-a157e966cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 1G" returned: 0 in 1.260s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d877a-2606-425c-a50e-10d5ce08821f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:20 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d877a-2606-425c-a50e-10d5ce08821f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02abe186-3d97-447f-9fc7-a157e966cc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843330863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3641088a-f258-4360-81eb-077d33fa2bd7,host='devstack@QuobyteHD#QuobyteHD',id=0f2daf61-a2d0-4b79-8095-037e5542a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:21Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56fa04e2-6638-4b25-9883-4b3372584686),volume_type_id=56fa04e2-6638-4b25-9883-4b3372584686)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:20 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:20 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb9bd3c-653b-4443-8245-1372fc441c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb9bd3c-653b-4443-8245-1372fc441c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f537271c-cfa2-457a-84f6-a188d0e5851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f537271c-cfa2-457a-84f6-a188d0e5851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2daf61-a2d0-4b79-8095-037e5542a11e', 'volume_name': 'volume-0f2daf61-a2d0-4b79-8095-037e5542a11e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de17b68-393c-4efc-a21b-e483dbff6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de17b68-393c-4efc-a21b-e483dbff6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79592a96-bde0-4f97-ac8b-445f747cd248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Volume 0f2daf61-a2d0-4b79-8095-037e5542a11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2daf61-a2d0-4b79-8095-037e5542a11e', 'volume_size': 1} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.262s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-76283f19-b629-45f7-be6b-26cf6e2b8eab tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-2bce6a81-a264-46d0-a35a-a700c40c0fb6-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:21 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758" returned: 0 in 1.121s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:21 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758 Jul 11 18:04:21 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:21 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d877a-2606-425c-a50e-10d5ce08821f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:21 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 is being set with open permissions: ugo+rw Jul 11 18:04:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:21 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 Jul 11 18:04:21 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:22 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-75c215c4-0c0d-4c8f-87d6-697dda2dc758" returned: 0 in 0.769s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-75c215c4-0c0d-4c8f-87d6-697dda2dc758" released by "delete_volume" :: held 1.960s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['6e739b6a-3532-4d22-9aee-e1f1d259d144', 'b5746b23-26eb-4996-a037-030e9a9809e4', '3057b084-327e-4286-aa9d-60a0e91f4abe', '16d154a1-a582-465b-b032-8d903d73e02c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:22 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:22 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:22 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465" returned: 0 in 0.755s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:22 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info Jul 11 18:04:22 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:23 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.706s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f63fcbd3-dc49-4907-b48e-3d7edbe736d7 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-75c215c4-0c0d-4c8f-87d6-697dda2dc758-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:23 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:23 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info is being set with open permissions: ugo+rw Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:23 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info Jul 11 18:04:23 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-d2cb2509-2977-497c-b1d4-86acecfe4cd5-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-d2cb2509-2977-497c-b1d4-86acecfe4cd5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=145,cinder:INSERT=45,cinder:UPDATE=188,cinder:DELETE=12 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=143,cinder:INSERT=43,cinder:UPDATE=187,cinder:DELETE=17 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-d2cb2509-2977-497c-b1d4-86acecfe4cd5" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-d2cb2509-2977-497c-b1d4-86acecfe4cd5" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbdf2c4-c4c0-4d92-8631-645c333aa044]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:23 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 Jul 11 18:04:23 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:23 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.info" returned: 0 in 0.855s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.365s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.098s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3641088a-f258-4360-81eb-077d33fa2bd7,created_at=2026-07-11T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843330863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3641088a-f258-4360-81eb-077d33fa2bd7,host='devstack@QuobyteHD#QuobyteHD',id=0f2daf61-a2d0-4b79-8095-037e5542a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:21Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56fa04e2-6638-4b25-9883-4b3372584686),volume_type_id=56fa04e2-6638-4b25-9883-4b3372584686)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Creating volume 0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:24 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:24 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e 1073741824 Jul 11 18:04:24 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5d065eb0-36da-4289-a67d-afd0c3e01d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Create snapshot completed successfully Jul 11 18:04:24 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5" returned: 0 in 1.040s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:24 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5 Jul 11 18:04:24 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:25 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e 1073741824" returned: 0 in 1.027s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:25 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e Jul 11 18:04:25 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "cinder-25f11333-5185-4b70-a4af-082076439465-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-25f11333-5185-4b70-a4af-082076439465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "cinder-quobyte-25f11333-5185-4b70-a4af-082076439465" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-25f11333-5185-4b70-a4af-082076439465" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Deleting offline snapshot 25f11333-5185-4b70-a4af-082076439465 of volume 630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:04:25 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] snapshot_file for this snap is: volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d2cb2509-2977-497c-b1d4-86acecfe4cd5" returned: 0 in 0.874s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6afcdc-ca78-4a43-8b90-340bdd2a303c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-d2cb2509-2977-497c-b1d4-86acecfe4cd5" released by "delete_volume" :: held 1.981s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['17459840-bb59-40cf-8d91-d4bc2f097e62', '4a47443a-4b2f-4607-9e54-778f3c8a1c84', 'b4dc125e-82ef-4991-9f78-c8ad207c12ca', 'a3a342ee-c324-45f3-a266-36d9d775ca46'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:25 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 Jul 11 18:04:25 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:25 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:25 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:26 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e" returned: 0 in 0.924s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79592a96-bde0-4f97-ac8b-445f747cd248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2daf61-a2d0-4b79-8095-037e5542a11e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597219d8-4ae3-4afb-afd2-cdde2153fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:26 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Volume volume-0f2daf61-a2d0-4b79-8095-037e5542a11e (0f2daf61-a2d0-4b79-8095-037e5542a11e): created successfully Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597219d8-4ae3-4afb-afd2-cdde2153fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (da821ad5-7883-4bee-bbb4-b080b21c62fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4da560c9-24d0-41e7-ae24-3e327f0cd196 tempest-GroupSnapshotsTest-1404717089 None] Created volume successfully. Jul 11 18:04:26 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465" returned: 0 in 0.891s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630d877a-2606-425c-a50e-10d5ce08821f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f56ff21-8dce-4325-8924-a6d3a5843add]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:26 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89736f8f-2df7-4e73-9d40-b20066321a0c tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-d2cb2509-2977-497c-b1d4-86acecfe4cd5-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:26 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f Jul 11 18:04:26 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d8a64a-e2d3-401a-839a-78a42a4cd66b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-aeb3554c-d213-4c5a-ab53-da6e2b39881f tempest-GroupSnapshotsTest-1404717089 None] Update group completed successfully. Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Flow 'volume_create_manager' (ca0ec37b-6314-466d-9862-cc1c7fb02a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce69931-7178-42eb-9967-b9807dd8a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce69931-7178-42eb-9967-b9807dd8a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-983175653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7887e9b-c15f-4d03-a6d7-b40495df9ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f4094baccc451298f3ac5c4bcb137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:27Z,use_quota=True,user_id='be646d177260442c9d3bfa1c889fbf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edc69aa-ed84-4da5-96ce-49fc6a0a513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edc69aa-ed84-4da5-96ce-49fc6a0a513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a1907c-cbd9-4cb7-adae-75d2d60bae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a1907c-cbd9-4cb7-adae-75d2d60bae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7887e9b-c15f-4d03-a6d7-b40495df9ad1', 'volume_name': 'volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b23a142-c861-4d6d-a5a8-640d5a947e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b23a142-c861-4d6d-a5a8-640d5a947e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e5828a-7426-4197-8f4e-82f9b5a7522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:27 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1', 'volume_size': 1} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-983175653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7887e9b-c15f-4d03-a6d7-b40495df9ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f4094baccc451298f3ac5c4bcb137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:27Z,use_quota=True,user_id='be646d177260442c9d3bfa1c889fbf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Creating volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:27 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:27 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 Jul 11 18:04:27 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:27 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 1073741824 Jul 11 18:04:27 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:27 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f" returned: 0 in 0.879s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:27 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 Jul 11 18:04:27 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:27 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" returned: 0 in 0.834s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:27 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6 Jul 11 18:04:27 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:28 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465" returned: 0 in 0.769s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:28 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 1073741824" returned: 0 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:28 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465 Jul 11 18:04:28 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:28 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 Jul 11 18:04:28 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:28 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-29115dbf-1484-48e4-a3a3-110a0e2aa2f3 tempest-GroupSnapshotsTest-1404717089 None] Update group completed successfully. Jul 11 18:04:28 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" returned: 0 in 0.695s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6" released by "delete_volume" :: held 1.579s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['a484fe3c-713b-4d73-a87f-e2b292dbdda6', '86235b18-5333-4328-b014-c8b927a44325', '727f32a2-e5de-425f-823a-90ddd608cf06', '0bef4a38-c67e-464a-b545-32bb4632ff59'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:28 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:28 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:28 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f.25f11333-5185-4b70-a4af-082076439465" returned: 0 in 0.742s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-25f11333-5185-4b70-a4af-082076439465" released by "_delete_snapshot" :: held 3.442s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" released by "delete_snapshot" :: held 3.483s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:28 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e5828a-7426-4197-8f4e-82f9b5a7522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd3c6b0-ae64-4156-be68-a448ea1195e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:28 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Volume volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 (a7887e9b-c15f-4d03-a6d7-b40495df9ad1): created successfully Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd3c6b0-ae64-4156-be68-a448ea1195e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Flow 'volume_create_manager' (ca0ec37b-6314-466d-9862-cc1c7fb02a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-138c34ed-6f24-4633-bd51-b54a75afe922 tempest-VolumesSnapshotListTestJSON-2063090132 None] Created volume successfully. Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Created reservations ['dd43d42e-a95e-490d-ae30-e6b4fdbc02d5', '6d7439cb-dcd1-4d1d-9722-7ec911d3ec31', '98ff1389-76e7-4dcc-80c1-6c36d637c4be', 'c6d46d2f-d9fd-4b78-a2f5-a21e646abd51'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Delete snapshot completed successfully. Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbfdbb4c-ef01-4ac7-b8a5-e1c7982a8272 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-25f11333-5185-4b70-a4af-082076439465-delete_snapshot" released by "delete_snapshot" :: held 3.688s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cba7b-0736-4413-8c1f-91b68aef8c13]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:29 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.743s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f9be6a9-327c-4f2f-b235-97c4e0f67b4d tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-9e98d07e-6a96-411b-87ef-8dc1b0c89ce6-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:29 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 Jul 11 18:04:29 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Creating offline snapshot a611e6a8-0db2-4120-a852-97a457249525 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e59429ab-012f-4509-b61c-6fcdd9018ec9 tempest-GroupSnapshotsTest-1404717089 None] Update group completed successfully. Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9793f20c-a038-4042-9c24-f58c5cea7421]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "cinder-630d877a-2606-425c-a50e-10d5ce08821f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-630d877a-2606-425c-a50e-10d5ce08821f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:29 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 Jul 11 18:04:29 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[140907da-535c-46bc-bbe8-148fe8437493]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:29 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f Jul 11 18:04:29 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:30 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" returned: 0 in 0.979s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:30 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9 Jul 11 18:04:30 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:30 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" returned: 0 in 0.807s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:30 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 1G Jul 11 18:04:30 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:30 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f" returned: 0 in 0.831s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:30 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f Jul 11 18:04:30 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3d62ebdf-049a-490e-8b4f-35d34f0cfd60 tempest-GroupSnapshotsTest-1404717089 None] Update group completed successfully. Jul 11 18:04:31 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9" released by "delete_volume" :: held 1.786s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['718e70f7-892f-4eec-9575-1183f954aae6', '8f87039a-9240-4d48-9f43-1e42f7857690', '12c49b0b-80e8-4cc0-808d-62a4db52bf5e', '81e954be-19b0-47c1-a5c7-4a8f94061c37'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:31 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:31 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:31 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 1G" returned: 0 in 0.840s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:31 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:04:31 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:31 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-630d877a-2606-425c-a50e-10d5ce08821f" returned: 0 in 0.714s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-quobyte-630d877a-2606-425c-a50e-10d5ce08821f" released by "delete_volume" :: held 1.616s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Created reservations ['e40ce571-cd9b-446d-9b56-e748471fc3f7', 'f48d7920-a8e4-41ee-aa6f-07bc850b10e6', '8d37c0b6-577b-43d0-b201-a401aa194bfc', '179f567c-a040-4766-9699-b31140910534'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-66c8a632-87ff-4cbc-b416-57bfd898fd1a-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-66c8a632-87ff-4cbc-b416-57bfd898fd1a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "cinder-quobyte-66c8a632-87ff-4cbc-b416-57bfd898fd1a" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:31 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:31 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-66c8a632-87ff-4cbc-b416-57bfd898fd1a" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbb5cd8-3b63-487e-a6a7-18102ecb8206]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:31 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a Jul 11 18:04:31 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:31 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:31 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d7c5ead-2243-48b2-80b8-2e0b868ee856 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-b23fa2e0-dc17-4562-8a1a-f33b7d7612e9-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:32 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.866s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:32 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 is being set with open permissions: ugo+rw Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:32 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:04:32 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] GroupSnapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: creating. Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Group snapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: creating. {{(pid=86932) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:04:32 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.976s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Deleted volume successfully. Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d2d28ac-ae4e-4ab1-b1aa-9f471b2d1796 tempest-VolumeSnapshotQuotasNegativeTestJSON-860809940 None] Lock "cinder-630d877a-2606-425c-a50e-10d5ce08821f-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:32 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a" returned: 0 in 1.074s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:32 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a Jul 11 18:04:32 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:33 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.881s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:33 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info Jul 11 18:04:33 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:33 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66c8a632-87ff-4cbc-b416-57bfd898fd1a" returned: 0 in 0.678s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-quobyte-66c8a632-87ff-4cbc-b416-57bfd898fd1a" released by "delete_volume" :: held 1.815s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Created reservations ['7fddfb47-28c3-478a-98f0-53bb964efb9c', '822c8a48-2d3c-46f8-b06c-019c37432e19', '486eff2e-a047-44c9-837f-7cc9da177b04', 'ab1d9ee7-8256-4263-a94f-259d6bf3da45'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:33 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:33 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:33 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info" returned: 0 in 0.792s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:33 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info is being set with open permissions: ugo+rw Jul 11 18:04:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:33 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info Jul 11 18:04:33 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:34 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:04:34 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:34 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.856s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Deleted volume successfully. Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b579d72d-e249-4519-87c3-345f1686d2a6 tempest-CreateVolumesFromSourceVolumeTest-1956398975 None] Lock "cinder-66c8a632-87ff-4cbc-b416-57bfd898fd1a-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:34 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.info" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.287s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.273s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Creating offline snapshot 72ab951d-9937-45ee-8cd0-0d551fdebe63 of volume 0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6247d1a9-b32e-4e3e-b723-5fa012d4d667 tempest-VolumesSnapshotListTestJSON-2063090132 None] Create snapshot completed successfully Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f53458-d227-485c-9db0-92cea2d3139f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:35 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e Jul 11 18:04:35 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:35 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.063s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:04:35 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e" returned: 0 in 0.934s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:35 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 1G Jul 11 18:04:35 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:36 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 1G" returned: 0 in 0.894s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2daf61-a2d0-4b79-8095-037e5542a11e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:36 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2daf61-a2d0-4b79-8095-037e5542a11e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 Jul 11 18:04:36 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:37 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f2daf61-a2d0-4b79-8095-037e5542a11e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:37 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:04:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:37 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 Jul 11 18:04:37 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:38 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:38 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info Jul 11 18:04:38 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:39 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info" returned: 0 in 0.761s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:39 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:39 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info Jul 11 18:04:39 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:39 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.info" returned: 0 in 0.710s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.997s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Creating offline snapshot c6d8d26e-d805-4f5b-b8ca-8a098277d93f of volume e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b8b98-082b-42b7-b33d-72a8df72db97]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:40 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea Jul 11 18:04:40 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:41 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea" returned: 0 in 1.074s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:41 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f 1G Jul 11 18:04:41 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:42 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f 1G" returned: 0 in 1.048s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e881b092-f880-410b-a8ab-d30079dab4ea -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:42 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e881b092-f880-410b-a8ab-d30079dab4ea -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f Jul 11 18:04:42 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:42 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e881b092-f880-410b-a8ab-d30079dab4ea -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:42 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:04:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:42 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f Jul 11 18:04:42 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:43 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f" returned: 0 in 0.723s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:43 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info Jul 11 18:04:43 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:44 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:44 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:04:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:44 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info Jul 11 18:04:44 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:45 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.info" returned: 0 in 0.775s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.296s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.113s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Creating offline snapshot 60ff3d48-f4ce-45d7-a126-c636f9967735 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7f373-883c-4159-a2e1-f39018ea9c2c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0a04153e-13a6-4e7f-a92c-78fabeef7e05 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: created successfully Jul 11 18:04:45 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:04:45 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:46 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.866s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:46 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 1G Jul 11 18:04:46 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: deleting Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: deleting {{(pid=86932) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-72ab951d-9937-45ee-8cd0-0d551fdebe63" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-72ab951d-9937-45ee-8cd0-0d551fdebe63" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Deleting offline snapshot 72ab951d-9937-45ee-8cd0-0d551fdebe63 of volume 0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] snapshot_file for this snap is: volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7406d770-edcc-4ddd-8cf0-fc97e865e515]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:46 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 Jul 11 18:04:46 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:47 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 1G" returned: 0 in 1.176s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:47 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:04:47 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:47 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63" returned: 0 in 1.091s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f2daf61-a2d0-4b79-8095-037e5542a11e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502729a-7c16-444c-ab0c-51a4ca5c416d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:48 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e Jul 11 18:04:48 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:48 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.890s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:48 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 is being set with open permissions: ugo+rw Jul 11 18:04:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:48 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:04:48 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:49 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e" returned: 0 in 1.137s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:49 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 Jul 11 18:04:49 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:49 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.989s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.066s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e76b771c-cce3-498f-912d-4d2e41572d5a tempest-VolumesSnapshotListTestJSON-2063090132 None] Create snapshot completed successfully Jul 11 18:04:49 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:49 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63 Jul 11 18:04:49 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Flow 'volume_create_manager' (54649697-afbe-4dec-a467-4b2a9ebb1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8103ab4-c4c0-46a4-b5c6-7d65507e3db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8103ab4-c4c0-46a4-b5c6-7d65507e3db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1944918822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f081ae-2b95-4557-af07-bf8804c201f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a926bcc6a0a46e99055e59bd937a83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:50Z,use_quota=True,user_id='529205d2b08a436aa57c8c428e12ed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea13a101-0499-489b-8ba2-4044acff72fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea13a101-0499-489b-8ba2-4044acff72fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7d31ea-a930-41ae-bfe0-106ef1784836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7d31ea-a930-41ae-bfe0-106ef1784836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f081ae-2b95-4557-af07-bf8804c201f7', 'volume_name': 'volume-c3f081ae-2b95-4557-af07-bf8804c201f7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2454d2a1-6ad8-4c57-be08-6d4fe720a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2454d2a1-6ad8-4c57-be08-6d4fe720a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296af6e9-671d-4248-8833-7e860b9a4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:50 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Volume c3f081ae-2b95-4557-af07-bf8804c201f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f081ae-2b95-4557-af07-bf8804c201f7', 'volume_size': 1} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Creating offline snapshot 51573209-e7ca-4750-a701-83fbd31acd64 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2087ae-2e56-459d-837c-94dc67d64529]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:50 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:04:50 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:50 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e.72ab951d-9937-45ee-8cd0-0d551fdebe63" returned: 0 in 0.707s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-72ab951d-9937-45ee-8cd0-0d551fdebe63" released by "_delete_snapshot" :: held 3.968s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" released by "delete_snapshot" :: held 4.015s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-c6d8d26e-d805-4f5b-b8ca-8a098277d93f" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-c6d8d26e-d805-4f5b-b8ca-8a098277d93f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Deleting offline snapshot c6d8d26e-d805-4f5b-b8ca-8a098277d93f of volume e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] snapshot_file for this snap is: volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f91ece-c559-468a-a8e9-276297f38249]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:50 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f Jul 11 18:04:50 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:51 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.905s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:51 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 1G Jul 11 18:04:51 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:51 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f" returned: 0 in 0.853s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e881b092-f880-410b-a8ab-d30079dab4ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6a962-51b7-4876-b68c-2acdc329f5d1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:51 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea Jul 11 18:04:51 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:52 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 1G" returned: 0 in 0.937s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:52 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 Jul 11 18:04:52 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:52 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:52 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f Jul 11 18:04:52 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:52 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64" returned: 0 in 0.754s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:52 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 is being set with open permissions: ugo+rw Jul 11 18:04:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:52 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 Jul 11 18:04:52 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:53 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f" returned: 0 in 0.832s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:53 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f Jul 11 18:04:53 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:53 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.551s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.499s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1944918822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f081ae-2b95-4557-af07-bf8804c201f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a926bcc6a0a46e99055e59bd937a83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:04:50Z,use_quota=True,user_id='529205d2b08a436aa57c8c428e12ed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Creating volume c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:04:53 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:04:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:53 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 1073741824 Jul 11 18:04:53 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-58f104d1-ef16-4715-b5d9-8ab9631ebfac tempest-VolumesSnapshotListTestJSON-2063090132 None] Create snapshot completed successfully Jul 11 18:04:54 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea.c6d8d26e-d805-4f5b-b8ca-8a098277d93f" returned: 0 in 0.716s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-c6d8d26e-d805-4f5b-b8ca-8a098277d93f" released by "_delete_snapshot" :: held 3.357s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" released by "delete_snapshot" :: held 3.387s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:54 devstack cinder-volume[86932]: WARNING cinder.quota [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1699558180 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1699558180, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:04:54 devstack cinder-volume[86932]: WARNING cinder.quota [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1699558180 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1699558180, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['09ff45c5-d351-4c7a-999f-0ea50782ac89', 'c047d9bd-199a-4279-ae5a-1381076314c8', '0453a034-cd63-434c-b6f3-1312c896f0fc', '8183e829-6c21-49ed-b715-eaf1340e17a0'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['1151b88a-4e01-41a7-a3cf-fbfc755d19d9', '7780d322-9736-47fb-a367-0209dff4c99c', '7f3e4022-d155-4a3c-8cf5-25e4371b2c93', 'c76a3858-ee37-49ca-986d-4705edb2a435'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2a1e4fa6-7e13-4bf5-a951-b183f27a5103 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 46f992b9-73ec-44cc-89b2-f319945c46c5: deleted successfully Jul 11 18:04:54 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 1073741824" returned: 0 in 1.108s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:54 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 Jul 11 18:04:54 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-51573209-e7ca-4750-a701-83fbd31acd64-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-51573209-e7ca-4750-a701-83fbd31acd64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-51573209-e7ca-4750-a701-83fbd31acd64" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-51573209-e7ca-4750-a701-83fbd31acd64" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Deleting offline snapshot 51573209-e7ca-4750-a701-83fbd31acd64 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] snapshot_file for this snap is: volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedd5a4f-9572-4c65-9568-25cf61e15a1e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:55 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7" returned: 0 in 0.877s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296af6e9-671d-4248-8833-7e860b9a4976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f081ae-2b95-4557-af07-bf8804c201f7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32185985-cb4f-43f3-99db-08cb7bd07a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:04:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Volume volume-c3f081ae-2b95-4557-af07-bf8804c201f7 (c3f081ae-2b95-4557-af07-bf8804c201f7): created successfully Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32185985-cb4f-43f3-99db-08cb7bd07a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Flow 'volume_create_manager' (54649697-afbe-4dec-a467-4b2a9ebb1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:04:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bad92f1b-2b4a-4f23-9c7c-5eab4f3a414c tempest-SnapshotMetadataTestJSON-1746308374 None] Created volume successfully. Jul 11 18:04:55 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 Jul 11 18:04:55 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e9171-b14c-4c59-9ee5-92742b550738]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:56 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e Jul 11 18:04:56 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:56 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64" returned: 0 in 0.975s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848dad6-2b8d-481c-a476-5ef4355a5e62]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Creating offline snapshot 493525d4-3472-4b8c-bb95-76636e5e17a6 of volume c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9676ab2e-ed84-467f-b1a3-d087a9290f20]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:56 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:04:56 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:57 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 Jul 11 18:04:57 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:57 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e" returned: 0 in 1.027s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:57 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e Jul 11 18:04:57 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:57 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.960s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:57 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 Jul 11 18:04:57 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:57 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f2daf61-a2d0-4b79-8095-037e5542a11e" returned: 0 in 0.860s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-0f2daf61-a2d0-4b79-8095-037e5542a11e" released by "delete_volume" :: held 1.988s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:04:57 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7" returned: 0 in 1.144s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" acquired by "delete_volume" :: waited 0.050s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:04:58 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 1G Jul 11 18:04:58 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095977a-df36-4381-a215-c7c3cb370449]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:58 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea Jul 11 18:04:58 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:58 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64" returned: 0 in 1.027s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:58 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64 Jul 11 18:04:58 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:59 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 1G" returned: 0 in 1.009s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f081ae-2b95-4557-af07-bf8804c201f7 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:59 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea" returned: 0 in 0.960s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:59 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f081ae-2b95-4557-af07-bf8804c201f7 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 Jul 11 18:04:59 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:59 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea Jul 11 18:04:59 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:04:59 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.51573209-e7ca-4750-a701-83fbd31acd64" returned: 0 in 0.860s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-51573209-e7ca-4750-a701-83fbd31acd64" released by "_delete_snapshot" :: held 3.984s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" released by "delete_snapshot" :: held 4.010s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Created reservations ['16000a8f-5baf-4933-b9ba-552db9ae7988', '5841bd52-19dd-426c-887a-b197853c9e71', '1062d47a-7ff2-4294-8d76-d9fb0a65d29c', '9c9c0e9c-811f-4ef7-b88f-c388ff0e2d68'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:04:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Delete snapshot completed successfully. Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7aa0a206-7a20-4347-908e-6404db50c116 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-51573209-e7ca-4750-a701-83fbd31acd64-delete_snapshot" released by "delete_snapshot" :: held 4.259s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:59 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e881b092-f880-410b-a8ab-d30079dab4ea" returned: 0 in 0.868s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-e881b092-f880-410b-a8ab-d30079dab4ea" released by "delete_volume" :: held 1.902s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:04:59 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f081ae-2b95-4557-af07-bf8804c201f7 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6" returned: 0 in 0.945s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:04:59 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 is being set with open permissions: ugo+rw Jul 11 18:04:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:04:59 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 Jul 11 18:04:59 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['8935e03f-6611-40b5-bf8b-535df4f3345a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:00 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1699558180 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1699558180, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['0cc3d0e7-da91-4ef3-a81f-d72a2337c8f5', '6ec3f186-ab4c-49fd-89c6-f7ed8d35611d', 'aae0378e-d614-4b4b-96ed-e67fb622f0bb', '6390275b-b330-4497-8590-9507b128814b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['0d381bb7-b039-43fa-bb8d-b45afd33c00f', '13b82d02-ee1b-4345-9920-152f3130f959', '7bb8498c-7406-4690-a962-802858dc0758', '6a7a2c8d-bce8-406e-85d0-ba7b13f62615'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:00 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:00 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:00 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:00 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info Jul 11 18:05:00 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-60ff3d48-f4ce-45d7-a126-c636f9967735-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-60ff3d48-f4ce-45d7-a126-c636f9967735-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-60ff3d48-f4ce-45d7-a126-c636f9967735" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-60ff3d48-f4ce-45d7-a126-c636f9967735" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Deleting offline snapshot 60ff3d48-f4ce-45d7-a126-c636f9967735 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] snapshot_file for this snap is: volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49f9ae-308f-4a5f-a270-c06fbf1570c9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:01 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.894s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a948e4e4-a334-4a47-98a2-9d712ae4549d tempest-GroupSnapshotsTest-1404717089 None] Delete group completed successfully. Jul 11 18:05:01 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:05:01 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:01 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info" returned: 0 in 0.900s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:01 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info is being set with open permissions: ugo+rw Jul 11 18:05:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:01 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info Jul 11 18:05:01 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0f7f9cc2-1805-4e91-b1fd-6195c8f0bfa2 tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-1865028177: creating Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0f7f9cc2-1805-4e91-b1fd-6195c8f0bfa2 tempest-GroupSnapshotsTest-1404717089 None] Group tempest-GroupSnapshotsTest-Group-1865028177: created successfully Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0f7f9cc2-1805-4e91-b1fd-6195c8f0bfa2 tempest-GroupSnapshotsTest-1404717089 None] Create group completed successfully. Jul 11 18:05:02 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 1.036s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d4e4e-0072-4743-87d2-2dc4cca45ad7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Flow 'volume_create_manager' (aff44ab9-0321-42be-8adc-2b8a43ecd4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d72e81-d057-4cc4-af68-e98faa874c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d72e81-d057-4cc4-af68-e98faa874c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943496842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fe55aa-b554-4564-ac03-3b826c96c697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c764d25042f74b298af26ed1e8e24da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:02Z,use_quota=True,user_id='2caa279659334ef6ba7b407a7af8b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bde08e-c4fc-40ac-b797-1eff1f4c0372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bde08e-c4fc-40ac-b797-1eff1f4c0372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1f1aa8-e1bb-4bc3-b8ab-d6365df331d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1f1aa8-e1bb-4bc3-b8ab-d6365df331d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fe55aa-b554-4564-ac03-3b826c96c697', 'volume_name': 'volume-19fe55aa-b554-4564-ac03-3b826c96c697', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdf8762-3dde-4e5b-a7ee-f12a842079fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdf8762-3dde-4e5b-a7ee-f12a842079fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:02 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:05:02 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925b31d-77e7-4d71-8413-9a7f69846ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Volume 19fe55aa-b554-4564-ac03-3b826c96c697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fe55aa-b554-4564-ac03-3b826c96c697', 'volume_size': 1} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:02 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.info" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.640s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943496842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fe55aa-b554-4564-ac03-3b826c96c697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c764d25042f74b298af26ed1e8e24da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:02Z,use_quota=True,user_id='2caa279659334ef6ba7b407a7af8b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Creating volume 19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:02 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 1073741824 Jul 11 18:05:02 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2a41d1fa-64cd-40f5-b80f-5badf5bebdcc tempest-SnapshotMetadataTestJSON-1746308374 None] Create snapshot completed successfully Jul 11 18:05:03 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:03 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:05:03 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:03 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 1073741824" returned: 0 in 1.010s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:03 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:03 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (6c062bdc-b5e2-4dca-9448-f0e0603ff8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e746ab3-425f-4c60-a21f-4ecae056635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e746ab3-425f-4c60-a21f-4ecae056635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-870965592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f03175-ba4a-4d70-adc3-830d51e5df84,host='devstack@QuobyteHD#QuobyteHD',id=57c329e5-44d8-47c7-8240-4836dac4c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:04Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b63941-84e7-43e6-8afb-d423c745af20),volume_type_id=03b63941-84e7-43e6-8afb-d423c745af20)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293aea3d-a52d-450d-8017-b9463589223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293aea3d-a52d-450d-8017-b9463589223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47de621f-6e76-4a43-b679-f3211f61fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47de621f-6e76-4a43-b679-f3211f61fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c329e5-44d8-47c7-8240-4836dac4c5a3', 'volume_name': 'volume-57c329e5-44d8-47c7-8240-4836dac4c5a3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484eee97-971a-4a08-9efb-cb1223b1c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484eee97-971a-4a08-9efb-cb1223b1c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924933b6-0336-4308-8ba7-8558eb861ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Volume 57c329e5-44d8-47c7-8240-4836dac4c5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c329e5-44d8-47c7-8240-4836dac4c5a3', 'volume_size': 1} Jul 11 18:05:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:04 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.978s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:04 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735 Jul 11 18:05:04 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "cinder-493525d4-3472-4b8c-bb95-76636e5e17a6-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-493525d4-3472-4b8c-bb95-76636e5e17a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "cinder-quobyte-493525d4-3472-4b8c-bb95-76636e5e17a6" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-493525d4-3472-4b8c-bb95-76636e5e17a6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Deleting offline snapshot 493525d4-3472-4b8c-bb95-76636e5e17a6 of volume c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] snapshot_file for this snap is: volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6c606-4b86-425c-996a-2558e9d6735b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:04 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 Jul 11 18:05:04 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:04 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98f03175-ba4a-4d70-adc3-830d51e5df84,created_at=2026-07-11T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-870965592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f03175-ba4a-4d70-adc3-830d51e5df84,host='devstack@QuobyteHD#QuobyteHD',id=57c329e5-44d8-47c7-8240-4836dac4c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3861aabb1124e14ba8fd5a03a0e001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:04Z,use_quota=True,user_id='c5fc20dd97c6466bbfc0070d3508ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b63941-84e7-43e6-8afb-d423c745af20),volume_type_id=03b63941-84e7-43e6-8afb-d423c745af20)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Creating volume 57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:04 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925b31d-77e7-4d71-8413-9a7f69846ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fe55aa-b554-4564-ac03-3b826c96c697', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:04 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 1073741824 Jul 11 18:05:04 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54868b99-beeb-414c-9be2-37b3c4db4e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Volume volume-19fe55aa-b554-4564-ac03-3b826c96c697 (19fe55aa-b554-4564-ac03-3b826c96c697): created successfully Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54868b99-beeb-414c-9be2-37b3c4db4e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Flow 'volume_create_manager' (aff44ab9-0321-42be-8adc-2b8a43ecd4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0f172df4-d949-438b-828e-31b1a9641383 tempest-SnapshotDependencyTests-587265147 None] Created volume successfully. Jul 11 18:05:04 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.60ff3d48-f4ce-45d7-a126-c636f9967735" returned: 0 in 0.722s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-60ff3d48-f4ce-45d7-a126-c636f9967735" released by "_delete_snapshot" :: held 3.697s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" released by "delete_snapshot" :: held 3.744s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Created reservations ['6dd6ef93-cdcd-4f3c-ae2e-702bd85e9eef', '1fd968a5-5fd8-438d-a22f-7cf055496a31', '6131441c-7289-48eb-ab33-9cb670276a32', '5e22aa80-cb9e-4bc9-924c-2d9d5133c5ff'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Delete snapshot completed successfully. Jul 11 18:05:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-464dffe8-93e2-4b2d-a88a-cb9541a25a3b tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-60ff3d48-f4ce-45d7-a126-c636f9967735-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:05 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6" returned: 0 in 0.880s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f081ae-2b95-4557-af07-bf8804c201f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e5f60-0487-4452-8998-7d81e31eeee1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:05 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 Jul 11 18:05:05 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:05 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 1073741824" returned: 0 in 0.897s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:05 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 Jul 11 18:05:05 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-a611e6a8-0db2-4120-a852-97a457249525-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-a611e6a8-0db2-4120-a852-97a457249525-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-a611e6a8-0db2-4120-a852-97a457249525" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a611e6a8-0db2-4120-a852-97a457249525" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Deleting offline snapshot a611e6a8-0db2-4120-a852-97a457249525 of volume a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] snapshot_file for this snap is: volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcafe1d2-4ff9-420a-9f9f-9c1308a0d464]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:05 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:05:05 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:05 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7" returned: 0 in 0.904s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:06 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 Jul 11 18:05:06 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:06 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.241s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924933b6-0336-4308-8ba7-8558eb861ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c329e5-44d8-47c7-8240-4836dac4c5a3', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412db45f-f4bf-4263-a417-51ac2260b369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Creating offline snapshot a501bc54-13ef-4eff-a19c-d266a1640cdd of volume 19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:05:06 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Volume volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 (57c329e5-44d8-47c7-8240-4836dac4c5a3): created successfully Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412db45f-f4bf-4263-a417-51ac2260b369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Flow 'volume_create_manager' (6c062bdc-b5e2-4dca-9448-f0e0603ff8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c8506-6762-40e6-93a3-deeb5e05b6fa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-98ceea77-6458-400c-9133-931b32078556 tempest-GroupSnapshotsTest-1404717089 None] Created volume successfully. Jul 11 18:05:06 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:06 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:06 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.871s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[395536da-2194-4016-9abc-b9adb32d3dd8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:06 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 Jul 11 18:05:06 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:06 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6" returned: 0 in 0.782s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:06 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6 Jul 11 18:05:06 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:06 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.815s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:06 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd 1G Jul 11 18:05:06 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:07 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" returned: 0 in 0.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:07 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:05:07 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:07 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7.493525d4-3472-4b8c-bb95-76636e5e17a6" returned: 0 in 0.680s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-493525d4-3472-4b8c-bb95-76636e5e17a6" released by "_delete_snapshot" :: held 3.370s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" released by "delete_snapshot" :: held 3.394s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] GroupSnapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: creating. Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Group snapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: creating. {{(pid=86932) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Created reservations ['52827418-6610-4329-8369-e5940ee45f6a', '01b649f3-95fb-4f2f-9775-ad5358ee5132', '0ae75cb8-15a6-4d19-be96-4121f1c7e3c8', 'cdb58154-ab84-4cc2-950e-12d6e9375f47'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Delete snapshot completed successfully. Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-13e260f8-b2ec-4f7d-bd26-e88093ea2b11 tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-493525d4-3472-4b8c-bb95-76636e5e17a6-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:07 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd 1G" returned: 0 in 0.927s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe55aa-b554-4564-ac03-3b826c96c697 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:07 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe55aa-b554-4564-ac03-3b826c96c697 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:07 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:07 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.807s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:07 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525 Jul 11 18:05:07 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "cinder-c3f081ae-2b95-4557-af07-bf8804c201f7-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-c3f081ae-2b95-4557-af07-bf8804c201f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206b053-fe4a-4d9b-ab03-fcf68e0963b8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:08 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe55aa-b554-4564-ac03-3b826c96c697 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 0.756s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:08 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd is being set with open permissions: ugo+rw Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:08 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:08 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:08 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1.a611e6a8-0db2-4120-a852-97a457249525" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:08 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 Jul 11 18:05:08 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a611e6a8-0db2-4120-a852-97a457249525" released by "_delete_snapshot" :: held 3.268s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" released by "delete_snapshot" :: held 3.305s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Created reservations ['094759e4-dcf8-4597-b517-fb600e50eb7f', '60da0ee7-d608-439d-ba18-ffb97d921344', '1b98c0f9-8228-4777-a30d-b5bc7218749a', 'dfc3fd50-a923-4bfb-a226-e27352566bf2'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Delete snapshot completed successfully. Jul 11 18:05:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47d6c631-77f4-4a35-a371-39f17327b689 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-a611e6a8-0db2-4120-a852-97a457249525-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:09 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 0.651s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:09 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:09 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info Jul 11 18:05:09 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7" returned: 0 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:09 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7 Jul 11 18:05:09 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-a7887e9b-c15f-4d03-a6d7-b40495df9ad1-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-a7887e9b-c15f-4d03-a6d7-b40495df9ad1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da3388f-77a1-40d7-891d-ef29b142afcf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:09 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 Jul 11 18:05:09 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:09 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:09 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info is being set with open permissions: ugo+rw Jul 11 18:05:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:10 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info Jul 11 18:05:10 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:10 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f081ae-2b95-4557-af07-bf8804c201f7" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-quobyte-c3f081ae-2b95-4557-af07-bf8804c201f7" released by "delete_volume" :: held 1.543s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Created reservations ['316c510c-386b-4c72-b092-6e5777842cb7', 'ce6e845a-b640-47a5-88b0-11c1d07f66c1', 'cc22c008-b080-472e-bbd3-5ff57c4c4e18', '3f619cae-0e5a-48f7-ac3f-04a615323f0b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:10 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:10 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:10 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:10 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1 Jul 11 18:05:10 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:10 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.info" returned: 0 in 0.673s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.648s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.054s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Creating offline snapshot 2430690d-bff5-4194-8749-8b17c35e4b45 of volume 57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef045d-2518-4d14-bd7a-55353cf70db8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fb7aefe0-cb86-4f42-8ed1-33ab7536ead4 tempest-SnapshotDependencyTests-587265147 None] Create snapshot completed successfully Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:10 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.722s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Deleted volume successfully. Jul 11 18:05:10 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 Jul 11 18:05:10 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c469a169-03bb-4b37-92ae-ed850772c4dd tempest-SnapshotMetadataTestJSON-1746308374 None] Lock "cinder-c3f081ae-2b95-4557-af07-bf8804c201f7-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:11 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-quobyte-a7887e9b-c15f-4d03-a6d7-b40495df9ad1" released by "delete_volume" :: held 1.622s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Created reservations ['62e2b95e-b4be-4f89-9da8-8c89fa2c9436', '010c3677-154f-4694-be3e-698917e9074f', '123ab841-b907-4c4a-a966-6cbb9ceb3079', 'abe54cc0-234e-42ed-b819-437aca922f58'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:11 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:11 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Flow 'volume_create_manager' (796baa7d-f757-4cc8-a28b-18ce584f71da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcbee9b-5a23-42f3-ac59-49919ad3ddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:11 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcbee9b-5a23-42f3-ac59-49919ad3ddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605a5ede-b3ee-4135-a9dd-45f3481ac50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c764d25042f74b298af26ed1e8e24da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a501bc54-13ef-4eff-a19c-d266a1640cdd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:12Z,use_quota=True,user_id='2caa279659334ef6ba7b407a7af8b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8990449a-0f7e-4819-a638-68c1c2b2f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8990449a-0f7e-4819-a638-68c1c2b2f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5961-0f34-4414-b1fd-2bf300ebde54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5961-0f34-4414-b1fd-2bf300ebde54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '605a5ede-b3ee-4135-a9dd-45f3481ac50c', 'volume_name': 'volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c', 'volume_size': 1, 'snapshot_id': 'a501bc54-13ef-4eff-a19c-d266a1640cdd'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e939f60e-40c2-44da-8658-2d9dc7be5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e939f60e-40c2-44da-8658-2d9dc7be5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71e3cf-3dc8-4f35-b3ea-c8ed272da33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:11 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Volume 605a5ede-b3ee-4135-a9dd-45f3481ac50c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c', 'volume_size': 1, 'snapshot_id': 'a501bc54-13ef-4eff-a19c-d266a1640cdd'} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3" returned: 0 in 1.054s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:11 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 1G Jul 11 18:05:11 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:12 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:12 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Deleted volume successfully. Jul 11 18:05:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-89da8665-bc46-4321-ab32-bb78b1465cf4 tempest-VolumesSnapshotListTestJSON-2063090132 None] Lock "cinder-a7887e9b-c15f-4d03-a6d7-b40495df9ad1-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:12 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 1G" returned: 0 in 0.991s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:12 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 Jul 11 18:05:12 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:13 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45" returned: 0 in 0.804s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:13 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:05:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:13 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 Jul 11 18:05:13 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:14 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:14 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info Jul 11 18:05:14 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:15 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info" returned: 0 in 0.711s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:15 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:15 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info Jul 11 18:05:15 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:15 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.info" returned: 0 in 0.707s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.096s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.952s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd-605a5ede-b3ee-4135-a9dd-45f3481ac50c" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd-605a5ede-b3ee-4135-a9dd-45f3481ac50c" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Creating volume 605a5ede-b3ee-4135-a9dd-45f3481ac50c from snapshot a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] snapshot: a501bc54-13ef-4eff-a19c-d266a1640cdd, volume: 605a5ede-b3ee-4135-a9dd-45f3481ac50c, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Flow 'volume_create_manager' (d7e4d179-83c9-40b8-9230-d5321050d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6144ef3b-9971-47e4-9d1e-7c0b78e6ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[13015562-0115-4126-a5f2-4ea58a4b94d6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6144ef3b-9971-47e4-9d1e-7c0b78e6ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1633495602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189c65a0-1be8-4b5e-98c9-2d36aff96c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c2aa56f0bc4934adc5e7a5ada976b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:16Z,use_quota=True,user_id='5e842d52739d488285c49c75c5a5c904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c5d700-39d6-48f1-a3c0-4e7c82ebd62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c5d700-39d6-48f1-a3c0-4e7c82ebd62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b098f2-ff9c-4318-9398-1890414da7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b098f2-ff9c-4318-9398-1890414da7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189c65a0-1be8-4b5e-98c9-2d36aff96c77', 'volume_name': 'volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d3a2d-a981-49a3-ad71-34002659ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d3a2d-a981-49a3-ad71-34002659ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f20fb5b-b400-47aa-872e-df396428b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Volume 189c65a0-1be8-4b5e-98c9-2d36aff96c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77', 'volume_size': 1} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-08773dab-eadd-4387-843d-cd13e9dc6620 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: created successfully Jul 11 18:05:16 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:16 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: deleting Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: deleting {{(pid=86932) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-2430690d-bff5-4194-8749-8b17c35e4b45" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-2430690d-bff5-4194-8749-8b17c35e4b45" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Deleting offline snapshot 2430690d-bff5-4194-8749-8b17c35e4b45 of volume 57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] snapshot_file for this snap is: volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129b286-d9f7-43cc-83c9-8b0a19d3b73e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:16 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 Jul 11 18:05:16 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:16 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 0.942s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19fe55aa-b554-4564-ac03-3b826c96c697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8627e568-ad50-4796-9e8b-00c171af9de7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:17 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:17 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:17 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45" returned: 0 in 0.840s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57c329e5-44d8-47c7-8240-4836dac4c5a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ff24da-968c-4be6-9d12-f88db3808bf7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:17 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 Jul 11 18:05:17 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:17 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.853s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:05:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:17 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c Jul 11 18:05:17 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:18 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3" returned: 0 in 0.829s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:18 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 Jul 11 18:05:18 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:19 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45" returned: 0 in 1.269s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:19 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45 Jul 11 18:05:19 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:20 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3.2430690d-bff5-4194-8749-8b17c35e4b45" returned: 0 in 1.530s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-2430690d-bff5-4194-8749-8b17c35e4b45" released by "_delete_snapshot" :: held 4.666s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" released by "delete_snapshot" :: held 4.708s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:21 devstack cinder-volume[86932]: WARNING cinder.quota [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1074449272 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1074449272, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:21 devstack cinder-volume[86932]: WARNING cinder.quota [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1074449272 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1074449272, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:21 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['6641922b-c496-4d5d-8706-05a61006375c', '3cac21bb-23ff-4bf2-b329-d5b8b3075c10', '504410e7-b9c0-4aed-978f-d1d7466a3f57', '4f5481bb-e4ec-4921-b372-c243bec646c6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-82895237-e303-4cea-9828-8e2a1f717ae4 tempest-GroupSnapshotsTest-1404717089 None] group_snapshot 57c6f0c4-ad64-4830-9cb0-d0204ef1ef74: deleted successfully Jul 11 18:05:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089e090-ab94-4265-aa3b-db2b35b88fe8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:23 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 Jul 11 18:05:23 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:23 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c" returned: 0 in 5.822s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0cd270-aecb-4a46-9de8-de924dc21adf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:23 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:23 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:24 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3" returned: 0 in 1.308s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:24 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3 Jul 11 18:05:24 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:24 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 1.299s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:24 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:05:24 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Converted 1024.00 MB image at 175.84 MB/s Jul 11 18:05:24 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c is being set with open permissions: ugo+rw Jul 11 18:05:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:24 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c Jul 11 18:05:24 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:25 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-57c329e5-44d8-47c7-8240-4836dac4c5a3" returned: 0 in 0.948s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Lock "cinder-quobyte-57c329e5-44d8-47c7-8240-4836dac4c5a3" released by "delete_volume" :: held 2.401s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=145,cinder:DELETE=6,cinder:UPDATE=148,cinder:INSERT=45 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=145,cinder:UPDATE=161,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['e9a9c236-37a5-41a8-84f1-5723399db224'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:25 devstack cinder-volume[86932]: WARNING cinder.quota [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1074449272 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1074449272, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Created reservations ['4315dfaa-cc76-4cee-bc86-af3109431522', '8e80f512-ea48-40c5-837b-53f0952aee74', '0a063e9c-ac40-4c1b-ba42-18bf9faf635f', '427bb55f-ac20-4456-bf97-86897cd4b973'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:25 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:25 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:25 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" released by "_copy_volume_from_snapshot" :: held 9.942s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd-605a5ede-b3ee-4135-a9dd-45f3481ac50c" released by "_create_volume_from_snapshot" :: held 9.995s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.034s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.736s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1633495602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189c65a0-1be8-4b5e-98c9-2d36aff96c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c2aa56f0bc4934adc5e7a5ada976b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:16Z,use_quota=True,user_id='5e842d52739d488285c49c75c5a5c904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Creating volume 189c65a0-1be8-4b5e-98c9-2d36aff96c77 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:25 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:25 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 1073741824 Jul 11 18:05:25 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71e3cf-3dc8-4f35-b3ea-c8ed272da33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c', 'volume_size': 1, 'snapshot_id': 'a501bc54-13ef-4eff-a19c-d266a1640cdd'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9b7e5f-e260-4560-8512-b728419abc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Volume volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c (605a5ede-b3ee-4135-a9dd-45f3481ac50c): created successfully Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9b7e5f-e260-4560-8512-b728419abc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Flow 'volume_create_manager' (796baa7d-f757-4cc8-a28b-18ce584f71da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a10b2e24-6676-4884-897b-2a6dcd28e40b tempest-SnapshotDependencyTests-587265147 None] Created volume successfully. Jul 11 18:05:26 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:26 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d0497255-e4ca-41f6-83d8-63a67864e2c4 tempest-GroupSnapshotsTest-1404717089 None] Delete group completed successfully. Jul 11 18:05:26 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 1073741824" returned: 0 in 1.004s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:26 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 Jul 11 18:05:26 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-a501bc54-13ef-4eff-a19c-d266a1640cdd-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-a501bc54-13ef-4eff-a19c-d266a1640cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Deleting offline snapshot a501bc54-13ef-4eff-a19c-d266a1640cdd of volume 19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] snapshot_file for this snap is: volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7c315c-942f-4535-8d7c-980fa39b3b13]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:27 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:27 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:27 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77" returned: 0 in 1.109s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f20fb5b-b400-47aa-872e-df396428b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bdd2ac-7bb9-4122-9e59-754731ac3a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:28 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Volume volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 (189c65a0-1be8-4b5e-98c9-2d36aff96c77): created successfully Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bdd2ac-7bb9-4122-9e59-754731ac3a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Flow 'volume_create_manager' (d7e4d179-83c9-40b8-9230-d5321050d874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:28 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-559957c5-046d-4710-b9c1-96b5b11c5b3c tempest-VolumesTransfersV357Test-1401365115 None] Created volume successfully. Jul 11 18:05:28 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 1.086s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19fe55aa-b554-4564-ac03-3b826c96c697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cebad9-961a-4e03-a15d-122c4e3a4a11]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:28 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:28 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:29 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.964s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:29 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:29 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b88f4566-16de-4d6e-a65c-495332a6302c tempest-VolumesTransfersV357Test-456897827 None] Transfer volume completed successfully. Jul 11 18:05:30 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 1.034s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:30 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd Jul 11 18:05:30 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:31 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697.a501bc54-13ef-4eff-a19c-d266a1640cdd" returned: 0 in 0.802s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-a501bc54-13ef-4eff-a19c-d266a1640cdd" released by "_delete_snapshot" :: held 4.055s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" released by "delete_snapshot" :: held 4.096s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "cinder-189c65a0-1be8-4b5e-98c9-2d36aff96c77-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-189c65a0-1be8-4b5e-98c9-2d36aff96c77-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "cinder-quobyte-189c65a0-1be8-4b5e-98c9-2d36aff96c77" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-quobyte-189c65a0-1be8-4b5e-98c9-2d36aff96c77" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Created reservations ['fcbb0b2b-adea-40de-9cac-56dd7fd5173a', 'eb446b69-db53-4460-a499-cb3831076c9b', '6ba0ea6f-030f-4777-8128-0ce433a0c3e7', '4d939fde-b1ca-443c-b594-676719e8963a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e70fc4-5d1f-485c-aac0-0147c8ec879e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Delete snapshot completed successfully. Jul 11 18:05:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3f43ebfd-37e5-4e77-8b88-696672f9cea7 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-a501bc54-13ef-4eff-a19c-d266a1640cdd-delete_snapshot" released by "delete_snapshot" :: held 4.430s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:31 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 Jul 11 18:05:31 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:32 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77" returned: 0 in 0.831s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:32 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77 Jul 11 18:05:32 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-19fe55aa-b554-4564-ac03-3b826c96c697-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-19fe55aa-b554-4564-ac03-3b826c96c697-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3513b8-e0dd-45d9-a7d5-691284c54cc2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:32 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:32 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1392ee26-ff77-445d-a4f6-2a2191f22c9e tempest-GroupSnapshotsV319Test-45198100 None] Group tempest-GroupSnapshotsV319Test-Group-88106261: creating Jul 11 18:05:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1392ee26-ff77-445d-a4f6-2a2191f22c9e tempest-GroupSnapshotsV319Test-45198100 None] Group tempest-GroupSnapshotsV319Test-Group-88106261: created successfully Jul 11 18:05:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1392ee26-ff77-445d-a4f6-2a2191f22c9e tempest-GroupSnapshotsV319Test-45198100 None] Create group completed successfully. Jul 11 18:05:33 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-189c65a0-1be8-4b5e-98c9-2d36aff96c77" returned: 0 in 0.876s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-quobyte-189c65a0-1be8-4b5e-98c9-2d36aff96c77" released by "delete_volume" :: held 1.774s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Created reservations ['a1d100b0-3bcd-49b2-bb42-31ba6d8fcf3e', 'ae7ee06f-a59c-4fbe-ab15-6855520e5301', 'd8ae0f81-051e-4f29-9c01-7fae41ea2a73', '49979552-7e45-4108-a939-d02fd7a267fd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:33 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:33 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:33 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:33 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697 Jul 11 18:05:33 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:34 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:34 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:34 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.948s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Deleted volume successfully. Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-24ff0670-b769-48eb-9560-5a72a9f2fac3 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-189c65a0-1be8-4b5e-98c9-2d36aff96c77-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:34 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-19fe55aa-b554-4564-ac03-3b826c96c697" returned: 0 in 0.874s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Flow 'volume_create_manager' (bb4f6bf4-0db2-4184-969a-92aaadbbeca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b18abd-475e-4bec-ae28-72508ad98649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-19fe55aa-b554-4564-ac03-3b826c96c697" released by "delete_volume" :: held 1.915s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b18abd-475e-4bec-ae28-72508ad98649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1307966608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365485da-9f97-44fe-9c85-a4b416c33e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c2aa56f0bc4934adc5e7a5ada976b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:34Z,use_quota=True,user_id='5e842d52739d488285c49c75c5a5c904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8778ab09-908d-4e0f-83b1-4fc960ea9b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8778ab09-908d-4e0f-83b1-4fc960ea9b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9b406a-8eb3-4ab2-8a38-adc39dd3d366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9b406a-8eb3-4ab2-8a38-adc39dd3d366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365485da-9f97-44fe-9c85-a4b416c33e2f', 'volume_name': 'volume-365485da-9f97-44fe-9c85-a4b416c33e2f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b114b-5255-48c0-ad12-bf406736fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b114b-5255-48c0-ad12-bf406736fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896faa9-d1bb-4e56-b719-8706606635d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:34 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Volume 365485da-9f97-44fe-9c85-a4b416c33e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365485da-9f97-44fe-9c85-a4b416c33e2f', 'volume_size': 1} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1307966608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365485da-9f97-44fe-9c85-a4b416c33e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c2aa56f0bc4934adc5e7a5ada976b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:34Z,use_quota=True,user_id='5e842d52739d488285c49c75c5a5c904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Creating volume 365485da-9f97-44fe-9c85-a4b416c33e2f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:34 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:34 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f 1073741824 Jul 11 18:05:34 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Created reservations ['d89d2f8b-8f6d-4588-9c71-8652748f5a68', '57f18f8d-a3db-4af3-861e-f97676d2d21b', '710f53e1-b58f-4001-9814-411e83786312', '490a660b-7bc1-40d9-ba2e-7ec123ad3e7b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:35 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:35 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-605a5ede-b3ee-4135-a9dd-45f3481ac50c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-605a5ede-b3ee-4135-a9dd-45f3481ac50c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Flow 'volume_create_manager' (cce0afb2-774c-4b69-b27d-b07dcbd5ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f0be1-1a6e-45c4-a0b8-2c3cb6622260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" acquired by "delete_volume" :: waited 0.084s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:35 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.278s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa02030a-2ca3-45d9-8d24-21c1bbe43a89]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f0be1-1a6e-45c4-a0b8-2c3cb6622260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358546667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a603e925-56b3-4169-935f-ecd38878350d,host='devstack@QuobyteHD#QuobyteHD',id=9cbd569e-c378-4d68-b11d-f99b8cee5e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cc64d28a204c9aa40e093ac75a9402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:35Z,use_quota=True,user_id='bda233c4b31c4dcc8134c5ca4d90f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d565e03-f495-4b7a-bc26-a3f881c19912),volume_type_id=8d565e03-f495-4b7a-bc26-a3f881c19912)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371a8bf1-bc9e-4753-92b4-8abaaf47cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371a8bf1-bc9e-4753-92b4-8abaaf47cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076bb09d-c632-41c7-86e2-d2ae44ec577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076bb09d-c632-41c7-86e2-d2ae44ec577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbd569e-c378-4d68-b11d-f99b8cee5e0e', 'volume_name': 'volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898f0d74-1113-4d9d-ac32-4172b435a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898f0d74-1113-4d9d-ac32-4172b435a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7047bd35-8c05-4a8e-b9eb-ff78f6583df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Volume 9cbd569e-c378-4d68-b11d-f99b8cee5e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e', 'volume_size': 1} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:35 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c Jul 11 18:05:35 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:36 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.061s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Deleted volume successfully. Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-323e5cce-ad8d-4685-908c-e96e6614a772 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-19fe55aa-b554-4564-ac03-3b826c96c697-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:36 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f 1073741824" returned: 0 in 1.402s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:36 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f Jul 11 18:05:36 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:36 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c" returned: 0 in 0.934s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:36 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c Jul 11 18:05:36 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:36 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f" returned: 0 in 0.804s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a603e925-56b3-4169-935f-ecd38878350d,created_at=2026-07-11T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358546667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a603e925-56b3-4169-935f-ecd38878350d,host='devstack@QuobyteHD#QuobyteHD',id=9cbd569e-c378-4d68-b11d-f99b8cee5e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cc64d28a204c9aa40e093ac75a9402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:35Z,use_quota=True,user_id='bda233c4b31c4dcc8134c5ca4d90f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d565e03-f495-4b7a-bc26-a3f881c19912),volume_type_id=8d565e03-f495-4b7a-bc26-a3f881c19912)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Creating volume 9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:36 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:37 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e 1073741824 Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896faa9-d1bb-4e56-b719-8706606635d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365485da-9f97-44fe-9c85-a4b416c33e2f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:37 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97c1d6d-8978-4903-a394-49c234ad5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Volume volume-365485da-9f97-44fe-9c85-a4b416c33e2f (365485da-9f97-44fe-9c85-a4b416c33e2f): created successfully Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97c1d6d-8978-4903-a394-49c234ad5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Flow 'volume_create_manager' (bb4f6bf4-0db2-4184-969a-92aaadbbeca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-61e7f2ae-263c-46e4-941c-3ffa198a80bb tempest-VolumesTransfersV357Test-1401365115 None] Created volume successfully. Jul 11 18:05:37 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-605a5ede-b3ee-4135-a9dd-45f3481ac50c" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-quobyte-605a5ede-b3ee-4135-a9dd-45f3481ac50c" released by "delete_volume" :: held 1.906s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Created reservations ['5b819418-38ae-4288-ac06-1298d4a6529e', '82eec596-05d5-4095-b150-0c1a3bd6711a', '6e30f8ff-1402-49c3-9b25-2bcf6d058609', '86972fc5-2eab-4af5-82a5-eda36ef35050'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:37 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:37 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "cinder-365485da-9f97-44fe-9c85-a4b416c33e2f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-365485da-9f97-44fe-9c85-a4b416c33e2f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "cinder-quobyte-365485da-9f97-44fe-9c85-a4b416c33e2f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-quobyte-365485da-9f97-44fe-9c85-a4b416c33e2f" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef4508b-9459-4da2-b8b1-7247046edbb9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:38 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e 1073741824" returned: 0 in 1.525s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:38 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f Jul 11 18:05:38 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:38 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e Jul 11 18:05:38 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:38 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.283s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Deleted volume successfully. Jul 11 18:05:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c04e3924-c440-4100-a28c-9abaf7af1a28 tempest-SnapshotDependencyTests-587265147 None] Lock "cinder-605a5ede-b3ee-4135-a9dd-45f3481ac50c-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:39 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f" returned: 0 in 1.098s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:39 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" returned: 0 in 0.959s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.566s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:39 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f Jul 11 18:05:39 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7047bd35-8c05-4a8e-b9eb-ff78f6583df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c99874e-d27f-43e1-ad9b-1bb716128db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Volume volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e (9cbd569e-c378-4d68-b11d-f99b8cee5e0e): created successfully Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c99874e-d27f-43e1-ad9b-1bb716128db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Flow 'volume_create_manager' (cce0afb2-774c-4b69-b27d-b07dcbd5ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c655bd71-b24c-4e34-9e05-f8b925f0777d tempest-GroupSnapshotsV319Test-45198100 None] Created volume successfully. Jul 11 18:05:40 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-365485da-9f97-44fe-9c85-a4b416c33e2f" returned: 0 in 0.889s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-quobyte-365485da-9f97-44fe-9c85-a4b416c33e2f" released by "delete_volume" :: held 2.059s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Created reservations ['3ca7e9d4-f1ee-4c45-b224-5f55c8417847', '160f4def-f2c0-4340-8129-0c6c96076437', 'dee63488-bc47-48a4-bb4c-085ae5de7edd', 'c334eda6-b9f1-4531-bf12-771c82bbe6f3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:40 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:40 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] GroupSnapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: creating. Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Group snapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: creating. {{(pid=86932) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Creating offline snapshot ba62da0b-db3c-490a-9533-617789fbaf75 of volume 9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4186ea-a264-4f68-bd13-4bc3e51e47b2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:41 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e Jul 11 18:05:41 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:41 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.106s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:41 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Deleted volume successfully. Jul 11 18:05:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-25368c4f-36b5-48ca-8e65-1e69d2cdbb96 tempest-VolumesTransfersV357Test-1354781566 None] Lock "cinder-365485da-9f97-44fe-9c85-a4b416c33e2f-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:42 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" returned: 0 in 1.202s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:42 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 1G Jul 11 18:05:42 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:43 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 1G" returned: 0 in 1.009s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:43 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 Jul 11 18:05:43 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:43 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75" returned: 0 in 0.887s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:43 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:05:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:44 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 Jul 11 18:05:44 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:44 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75" returned: 0 in 0.694s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:44 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info Jul 11 18:05:44 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:45 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info" returned: 0 in 0.745s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:45 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:05:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:45 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info Jul 11 18:05:45 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:46 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.info" returned: 0 in 0.838s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.509s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-13de900b-c089-4abc-9bff-7d64fce6411c tempest-GroupSnapshotsV319Test-45198100 None] group_snapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: created successfully Jul 11 18:05:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] group_snapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: deleting Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] group_snapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: deleting {{(pid=86932) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "cinder-quobyte-ba62da0b-db3c-490a-9533-617789fbaf75" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-ba62da0b-db3c-490a-9533-617789fbaf75" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Deleting offline snapshot ba62da0b-db3c-490a-9533-617789fbaf75 of volume 9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] snapshot_file for this snap is: volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8ceb7-8259-4b50-bf08-64e05f2c0e79]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:48 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 Jul 11 18:05:48 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:48 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75" returned: 0 in 1.035s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:05:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60ca053-0332-48fb-90fc-7118aebf48df]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:49 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e Jul 11 18:05:49 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:49 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" returned: 0 in 0.919s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:49 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 Jul 11 18:05:49 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Flow 'volume_create_manager' (008465ef-3a02-4b6b-a951-6dd0850c58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a6f3b-667a-4340-96e6-f15699d8a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a6f3b-667a-4340-96e6-f15699d8a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-525723375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7ed8c1-ff4c-482c-83f7-35a594b26270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4967db35729a465596ce6e8e2fa28500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:50Z,use_quota=True,user_id='255905c070a5487aa8bc8f56b9ea17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33eabc-9998-4d87-9e8c-1a3a480ad24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33eabc-9998-4d87-9e8c-1a3a480ad24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765688b-9062-4d4c-af3e-e0c7c11bd3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765688b-9062-4d4c-af3e-e0c7c11bd3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7ed8c1-ff4c-482c-83f7-35a594b26270', 'volume_name': 'volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270', 'volume_size': 2}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e8ba70-8e3e-4da6-8f60-ae120802b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e8ba70-8e3e-4da6-8f60-ae120802b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66189695-1c9c-4970-9d6d-9e8df3b4c8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:50 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Volume 6f7ed8c1-ff4c-482c-83f7-35a594b26270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270', 'volume_size': 2} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-525723375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7ed8c1-ff4c-482c-83f7-35a594b26270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4967db35729a465596ce6e8e2fa28500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:50Z,use_quota=True,user_id='255905c070a5487aa8bc8f56b9ea17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Creating volume 6f7ed8c1-ff4c-482c-83f7-35a594b26270 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:50 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 2147483648 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:50 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 2147483648 Jul 11 18:05:50 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:50 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75" returned: 0 in 0.936s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:50 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75 Jul 11 18:05:50 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:51 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 2147483648" returned: 0 in 1.083s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:51 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 Jul 11 18:05:51 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:51 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e.ba62da0b-db3c-490a-9533-617789fbaf75" returned: 0 in 0.746s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-ba62da0b-db3c-490a-9533-617789fbaf75" released by "_delete_snapshot" :: held 3.790s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" released by "delete_snapshot" :: held 3.856s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:51 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-855042766 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-855042766, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:51 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-855042766 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-855042766, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] Created reservations ['296e073d-7b88-4ed5-82ce-a6398154effe', '19351eab-3238-47b6-9881-5a336edb24df', '95b606b5-9fd4-4312-adae-c96ed9dd8442', 'e6783942-2dbd-486f-9d13-0a3760a1b967'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a900d7a4-75c0-4b79-a306-8b423979520b tempest-GroupSnapshotsV319Test-45198100 None] group_snapshot 1d1683b5-76b9-4ef2-b4f9-00355c078ce6: deleted successfully Jul 11 18:05:51 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270" returned: 0 in 0.682s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66189695-1c9c-4970-9d6d-9e8df3b4c8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270', 'volume_size': 2}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a1bf26-305b-442a-a427-5c07658665f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Volume volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 (6f7ed8c1-ff4c-482c-83f7-35a594b26270): created successfully Jul 11 18:05:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a1bf26-305b-442a-a427-5c07658665f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Flow 'volume_create_manager' (008465ef-3a02-4b6b-a951-6dd0850c58e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:52 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-34674ba0-635e-4106-9186-8deab23519cf tempest-VolumesCloneNegativeTest-427101083 None] Created volume successfully. Jul 11 18:05:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ad4191-34a1-4222-b429-77a05e1fbe9a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:52 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e Jul 11 18:05:52 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:53 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" returned: 0 in 0.785s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:53 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e Jul 11 18:05:53 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Acquiring lock "cinder-6f7ed8c1-ff4c-482c-83f7-35a594b26270-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "cinder-6f7ed8c1-ff4c-482c-83f7-35a594b26270-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Acquiring lock "cinder-quobyte-6f7ed8c1-ff4c-482c-83f7-35a594b26270" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "cinder-quobyte-6f7ed8c1-ff4c-482c-83f7-35a594b26270" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac37b8-9370-4f73-babf-2eb2637be2d4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:05:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:53 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 Jul 11 18:05:53 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:54 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" returned: 0 in 0.798s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Lock "cinder-quobyte-9cbd569e-c378-4d68-b11d-f99b8cee5e0e" released by "delete_volume" :: held 1.647s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Created reservations ['c2243557-4096-4d64-899a-1d3a6bdec7f7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:54 devstack cinder-volume[86932]: WARNING cinder.quota [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-855042766 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-855042766, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Created reservations ['8a5482d7-7e14-4e2a-9218-00d3ce647c17', '878a31d0-d330-4f22-aeaf-ff95cf1c120b', '03f9d68c-8bf1-4389-8600-e5a662d244af', '9e5cb9e9-00f8-4940-97b8-6ea568f7b797'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:54 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270" returned: 0 in 0.913s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:54 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:54 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:54 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270 Jul 11 18:05:54 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:55 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.791s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a9fb557b-d204-4701-a8e5-df0414dd0282 tempest-GroupSnapshotsV319Test-45198100 None] Delete group completed successfully. Jul 11 18:05:55 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-6f7ed8c1-ff4c-482c-83f7-35a594b26270" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "cinder-quobyte-6f7ed8c1-ff4c-482c-83f7-35a594b26270" released by "delete_volume" :: held 1.760s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Created reservations ['ce987bd3-c761-4532-bcce-54677d98d1b8', 'a21bc181-8947-4505-828c-11c57b306b13', '2ae866c9-e719-461f-8db4-cf1a2dc76d7a', '6a76a543-dcb2-41fe-ba80-6a6a2611dd9b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:55 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:05:55 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:05:56 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 11 18:05:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.872s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:05:56 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:05:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Deleted volume successfully. Jul 11 18:05:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4f3b5312-3007-40a9-aca6-033844c922cf tempest-VolumesCloneNegativeTest-427101083 None] Lock "cinder-6f7ed8c1-ff4c-482c-83f7-35a594b26270-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (bc6abf77-f0a5-4e98-b6a5-658ee658ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b2de7-ee69-4143-9ca7-5c24a3916b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b2de7-ee69-4143-9ca7-5c24a3916b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1289319801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:59Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9fdbe7-f91d-44ec-ae8b-d2203b589b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9fdbe7-f91d-44ec-ae8b-d2203b589b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72738c2-d8c1-44df-a2ab-1d744ccf6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72738c2-d8c1-44df-a2ab-1d744ccf6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d', 'volume_name': 'volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2bca60-fe3f-4093-826c-c77f8db47d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2bca60-fe3f-4093-826c-c77f8db47d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc1a6a6-4399-4cb8-8f3b-5bedec2573ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:05:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Volume bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d', 'volume_size': 1} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1289319801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:05:59Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Creating volume bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:05:59 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:05:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:05:59 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d 1073741824 Jul 11 18:05:59 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:00 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d 1073741824" returned: 0 in 1.056s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:00 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d Jul 11 18:06:00 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:01 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" returned: 0 in 0.973s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc1a6a6-4399-4cb8-8f3b-5bedec2573ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06978141-d64a-4329-826e-174919cc98b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Volume volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d (bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d): created successfully Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06978141-d64a-4329-826e-174919cc98b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (bc6abf77-f0a5-4e98-b6a5-658ee658ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5e22fda1-06f6-48b9-a40a-caa1fd9a90a2 tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (3c66269d-6e8b-4660-9ca6-e90d5040b56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b18f77-ae2c-4540-8b6a-d7bcd02bf5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b18f77-ae2c-4540-8b6a-d7bcd02bf5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-330118137',display_name='tempest-VolumesGetTest-Volume-754835799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df91922-2a8e-497e-ab34-82653fca2843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:03Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccd3e8a-303d-4260-bb1a-30729b221bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccd3e8a-303d-4260-bb1a-30729b221bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c490e8c0-2198-4a1d-b2a3-59d2ef3ef4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c490e8c0-2198-4a1d-b2a3-59d2ef3ef4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df91922-2a8e-497e-ab34-82653fca2843', 'volume_name': 'volume-4df91922-2a8e-497e-ab34-82653fca2843', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f627cede-c15c-4eaf-9017-61f0106867da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f627cede-c15c-4eaf-9017-61f0106867da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4d89a6-7d98-49f9-abf8-1fcb2b57f0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Volume 4df91922-2a8e-497e-ab34-82653fca2843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df91922-2a8e-497e-ab34-82653fca2843', 'volume_size': 1} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-330118137',display_name='tempest-VolumesGetTest-Volume-754835799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df91922-2a8e-497e-ab34-82653fca2843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:03Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Creating volume 4df91922-2a8e-497e-ab34-82653fca2843 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:03 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:03 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 1073741824 Jul 11 18:06:03 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:04 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 1073741824" returned: 0 in 1.075s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:04 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 Jul 11 18:06:04 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:05 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843" returned: 0 in 0.806s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4d89a6-7d98-49f9-abf8-1fcb2b57f0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df91922-2a8e-497e-ab34-82653fca2843', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7fda54-7422-41e8-a876-13669ddb45ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:05 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Volume volume-4df91922-2a8e-497e-ab34-82653fca2843 (4df91922-2a8e-497e-ab34-82653fca2843): created successfully Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7fda54-7422-41e8-a876-13669ddb45ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (3c66269d-6e8b-4660-9ca6-e90d5040b56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-24e9c809-9566-44c6-ba95-3443813484f9 tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-4df91922-2a8e-497e-ab34-82653fca2843-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "cinder-4df91922-2a8e-497e-ab34-82653fca2843-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-4df91922-2a8e-497e-ab34-82653fca2843" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-4df91922-2a8e-497e-ab34-82653fca2843" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e48aaec5-00d8-43dd-919f-2c58775b507c tempest-GroupsTest-667400971 None] Group tempest-Group1-211992771: creating Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16886de-c23d-4e26-88d8-a9046ba5778e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e48aaec5-00d8-43dd-919f-2c58775b507c tempest-GroupsTest-667400971 None] Group tempest-Group1-211992771: created successfully Jul 11 18:06:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e48aaec5-00d8-43dd-919f-2c58775b507c tempest-GroupsTest-667400971 None] Create group completed successfully. Jul 11 18:06:06 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 Jul 11 18:06:06 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:07 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843" returned: 0 in 0.781s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:07 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843 Jul 11 18:06:07 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-41eb0331-f317-4db5-b35d-25d84706d8c8 tempest-GroupsTest-667400971 None] Group tempest-Group2-764025201: creating Jul 11 18:06:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-41eb0331-f317-4db5-b35d-25d84706d8c8 tempest-GroupsTest-667400971 None] Group tempest-Group2-764025201: created successfully Jul 11 18:06:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-41eb0331-f317-4db5-b35d-25d84706d8c8 tempest-GroupsTest-667400971 None] Create group completed successfully. Jul 11 18:06:08 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4df91922-2a8e-497e-ab34-82653fca2843" returned: 0 in 0.720s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-4df91922-2a8e-497e-ab34-82653fca2843" released by "delete_volume" :: held 1.540s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Created reservations ['3b327e26-6703-40ab-b9e4-57b6ac1c722b', '5b92d719-141b-4bcc-944a-74934efcee56', 'f78dddb0-f072-4219-8d55-0ce41dcb681a', '4366107c-ed9e-4e89-95b6-08dd630c2649'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:08 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:08 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "cinder-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d1d8ad-7861-4d89-b8ab-d5df628adbab]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:09 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.685s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3aa2ada0-4ed0-4b52-afa7-0b7a9e05b76d tempest-VolumesGetTest-1731128797 None] Lock "cinder-4df91922-2a8e-497e-ab34-82653fca2843-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:09 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d Jul 11 18:06:09 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (a5fef587-66bf-4c5c-bcf9-9ba4abcf550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155c719d-1419-486f-9818-61bddf1dfd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155c719d-1419-486f-9818-61bddf1dfd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131852748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb6d4b18-8452-47d5-9891-26a0a1c50685,host='devstack@QuobyteHD#QuobyteHD',id=163fe766-ca24-45e1-a43f-03143ec532bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:10Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2ba7b1-01b4-4246-adb8-5e160def28b9),volume_type_id=8f2ba7b1-01b4-4246-adb8-5e160def28b9)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896df8dc-b858-4591-b80a-185e8a419a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896df8dc-b858-4591-b80a-185e8a419a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb579e5d-137c-4785-813a-0396ec025a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb579e5d-137c-4785-813a-0396ec025a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163fe766-ca24-45e1-a43f-03143ec532bd', 'volume_name': 'volume-163fe766-ca24-45e1-a43f-03143ec532bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a6d664-e204-4277-bf17-fc3177b20863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a6d664-e204-4277-bf17-fc3177b20863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233e5b9e-af68-49b1-89a4-4a6a1c870fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Volume 163fe766-ca24-45e1-a43f-03143ec532bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163fe766-ca24-45e1-a43f-03143ec532bd', 'volume_size': 1} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb6d4b18-8452-47d5-9891-26a0a1c50685,created_at=2026-07-11T16:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131852748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb6d4b18-8452-47d5-9891-26a0a1c50685,host='devstack@QuobyteHD#QuobyteHD',id=163fe766-ca24-45e1-a43f-03143ec532bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:10Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2ba7b1-01b4-4246-adb8-5e160def28b9),volume_type_id=8f2ba7b1-01b4-4246-adb8-5e160def28b9)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Creating volume 163fe766-ca24-45e1-a43f-03143ec532bd {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:09 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:09 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" returned: 0 in 0.801s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:09 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd 1073741824 Jul 11 18:06:09 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:09 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d Jul 11 18:06:09 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:10 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" returned: 0 in 0.678s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d" released by "delete_volume" :: held 1.528s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Created reservations ['b647dd4e-c70a-4391-bd43-78bca763f10e', 'dd68332d-8437-46c1-a28e-1cd38e8f325f', '506b47ee-d862-40fe-806f-ce08582c8ed2', 'd4bbb2c4-521f-46cb-984e-637c5ee69575'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:10 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd 1073741824" returned: 0 in 0.872s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:10 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:10 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:10 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd Jul 11 18:06:10 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:11 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-39d708bc-413a-4ad4-b11a-7ce567c278f1 tempest-VolumesGetTest-1731128797 None] Lock "cinder-bc0f0ef1-6a01-43e9-a333-30f6f2c9d40d-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:11 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233e5b9e-af68-49b1-89a4-4a6a1c870fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163fe766-ca24-45e1-a43f-03143ec532bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc1afe4-9320-40fe-b7ac-485ce8cd33cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Volume volume-163fe766-ca24-45e1-a43f-03143ec532bd (163fe766-ca24-45e1-a43f-03143ec532bd): created successfully Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc1afe4-9320-40fe-b7ac-485ce8cd33cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (a5fef587-66bf-4c5c-bcf9-9ba4abcf550f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-84f61038-0d32-4faf-af82-23586ff1b7af tempest-GroupsTest-667400971 None] Created volume successfully. Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (f9f921c6-83e7-4a99-b69c-1f72c3b0e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bc98f4-6caf-4a55-9c87-53ed3dce6365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bc98f4-6caf-4a55-9c87-53ed3dce6365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185457255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f5685d-6000-4163-82c5-3dac8ef967ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:12Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f841eaba-6397-437f-a281-843d97c8ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f841eaba-6397-437f-a281-843d97c8ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c930a-1140-45ee-bd44-a62f93d6da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c930a-1140-45ee-bd44-a62f93d6da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f5685d-6000-4163-82c5-3dac8ef967ee', 'volume_name': 'volume-b7f5685d-6000-4163-82c5-3dac8ef967ee', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95d209a-f4cb-4677-8ead-cbdbb890bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95d209a-f4cb-4677-8ead-cbdbb890bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7666a95-8168-4861-96b5-566a71a5478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:11 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Volume b7f5685d-6000-4163-82c5-3dac8ef967ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f5685d-6000-4163-82c5-3dac8ef967ee', 'volume_size': 1} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185457255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f5685d-6000-4163-82c5-3dac8ef967ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:12Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Creating volume b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:11 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:11 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee 1073741824 Jul 11 18:06:11 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Acquiring lock "cinder-quobyte-163fe766-ca24-45e1-a43f-03143ec532bd" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-163fe766-ca24-45e1-a43f-03143ec532bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b361e1f-481f-43ba-98cb-80106f936026]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:12 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee 1073741824" returned: 0 in 0.929s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:12 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:12 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:12 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd Jul 11 18:06:13 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:13 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7666a95-8168-4861-96b5-566a71a5478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f5685d-6000-4163-82c5-3dac8ef967ee', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:13 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76993dae-8c53-44e0-8461-f1c3a98bcf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd" returned: 0 in 0.844s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:13 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Volume volume-b7f5685d-6000-4163-82c5-3dac8ef967ee (b7f5685d-6000-4163-82c5-3dac8ef967ee): created successfully Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76993dae-8c53-44e0-8461-f1c3a98bcf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:13 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd Jul 11 18:06:13 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (f9f921c6-83e7-4a99-b69c-1f72c3b0e113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bfddeec2-626d-4c42-91cb-641decd3677a tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:14 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (5ed21637-c2c7-438e-b759-981af979e1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67629b0-597c-4a77-9cde-d718e1c77e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-163fe766-ca24-45e1-a43f-03143ec532bd" returned: 0 in 0.814s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67629b0-597c-4a77-9cde-d718e1c77e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704611326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2328f5e-54df-4983-a18b-478fbecb4c66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b7f5685d-6000-4163-82c5-3dac8ef967ee,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:14Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e0a87a-3206-4803-9304-4df77046810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e0a87a-3206-4803-9304-4df77046810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a71ef48-9771-461d-a1fe-0a42a46bf660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-163fe766-ca24-45e1-a43f-03143ec532bd" released by "delete_volume" :: held 1.744s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a71ef48-9771-461d-a1fe-0a42a46bf660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c2328f5e-54df-4983-a18b-478fbecb4c66', 'volume_name': 'volume-c2328f5e-54df-4983-a18b-478fbecb4c66', 'volume_size': 1, 'source_volid': 'b7f5685d-6000-4163-82c5-3dac8ef967ee', 'source_volstatus': 'available'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd382db-30de-4103-8c46-e7647f6f4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd382db-30de-4103-8c46-e7647f6f4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2240b-2ab6-4e5e-b045-c054f232c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Volume c2328f5e-54df-4983-a18b-478fbecb4c66: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c2328f5e-54df-4983-a18b-478fbecb4c66', 'volume_size': 1, 'source_volid': 'b7f5685d-6000-4163-82c5-3dac8ef967ee', 'source_volstatus': 'available'} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Cloning volume b7f5685d-6000-4163-82c5-3dac8ef967ee to volume c2328f5e-54df-4983-a18b-478fbecb4c66 Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Created reservations ['93290b5c-9f43-4a20-9cac-2b7fae4f6e6a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Creating offline snapshot f82c415e-00ad-4f47-8b16-72756a588d62 of volume b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc318b4-338f-41b5-96bc-7e7fa786cfdf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:14 devstack cinder-volume[86932]: WARNING cinder.quota [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-855861441 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-855861441, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:06:14 devstack cinder-volume[86932]: WARNING cinder.quota [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-855861441 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-855861441, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Created reservations ['840aca7e-c656-43eb-b5f1-409d913789c8', '3dff7222-85d3-4785-816a-f122e8376bf2', '4a23341b-58bc-4b0f-a34a-b1d676b8f7bd', '69b4006d-7ec9-4723-86cd-698d028e50bb'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:14 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:14 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:14 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:14 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Created reservations ['b302c5dc-7b5b-4c7d-967f-4b5de27da690'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:15 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:15 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:15 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b3950b71-bb6c-4fa7-a8eb-478ae388597d tempest-GroupsTest-667400971 None] Delete group completed successfully. Jul 11 18:06:15 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.906s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:15 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 1G Jul 11 18:06:15 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:16 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:16 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2bfd4dc2-e9dd-49f2-89b2-e9a3662a302c tempest-GroupsTest-667400971 None] Delete group completed successfully. Jul 11 18:06:16 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 1G" returned: 0 in 0.769s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f5685d-6000-4163-82c5-3dac8ef967ee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:16 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f5685d-6000-4163-82c5-3dac8ef967ee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:16 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0def41e8-9f72-429f-baa7-28655454e699 tempest-GroupsTest-667400971 None] Group tempest-GroupsTest-Group-1005650771: creating Jul 11 18:06:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0def41e8-9f72-429f-baa7-28655454e699 tempest-GroupsTest-667400971 None] Group tempest-GroupsTest-Group-1005650771: created successfully Jul 11 18:06:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0def41e8-9f72-429f-baa7-28655454e699 tempest-GroupsTest-667400971 None] Create group completed successfully. Jul 11 18:06:17 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f5685d-6000-4163-82c5-3dac8ef967ee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:17 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 is being set with open permissions: ugo+rw Jul 11 18:06:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:17 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:17 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:17 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.632s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:17 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info Jul 11 18:06:17 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:18 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info" returned: 0 in 0.653s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:18 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info is being set with open permissions: ugo+rw Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:18 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info Jul 11 18:06:18 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (07f1c732-ddf3-46d1-8971-5e897eafdd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4368c288-8822-45b2-bc42-2dfaba1dee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4368c288-8822-45b2-bc42-2dfaba1dee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-435967246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f2ba450-394a-4281-9504-17d2d902d6e4,host='devstack@QuobyteHD#QuobyteHD',id=294a87bd-78b4-41b6-a713-6475179a97f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:18Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d238b9d5-0bd0-48c7-aa74-941eb5f59357),volume_type_id=d238b9d5-0bd0-48c7-aa74-941eb5f59357)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158dc2dc-eec7-4c76-81cf-cbce09c83206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158dc2dc-eec7-4c76-81cf-cbce09c83206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa3f837-afd3-48aa-97aa-25d706fa1139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa3f837-afd3-48aa-97aa-25d706fa1139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294a87bd-78b4-41b6-a713-6475179a97f7', 'volume_name': 'volume-294a87bd-78b4-41b6-a713-6475179a97f7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7221f785-379d-42a1-ab2b-6d00aeb4b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7221f785-379d-42a1-ab2b-6d00aeb4b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3de59-09ad-4420-8f60-3bc97dcd38bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Volume 294a87bd-78b4-41b6-a713-6475179a97f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294a87bd-78b4-41b6-a713-6475179a97f7', 'volume_size': 1} Jul 11 18:06:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:19 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.info" returned: 0 in 0.691s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] snapshot: f82c415e-00ad-4f47-8b16-72756a588d62, volume: c2328f5e-54df-4983-a18b-478fbecb4c66, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b419c397-5dd5-4d7d-a06c-613b2291ab91]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:19 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:19 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:19 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.736s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f5685d-6000-4163-82c5-3dac8ef967ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d19859-76a6-461f-bcc6-b4bb4ebf8ff2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:20 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:20 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:20 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:20 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:06:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:20 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 Jul 11 18:06:20 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:25 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66" returned: 0 in 5.117s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1977579-e744-4849-b57f-9ff844aba6e3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:25 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:25 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:26 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.947s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:26 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:06:26 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Converted 1024.00 MB image at 200.08 MB/s Jul 11 18:06:26 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 is being set with open permissions: ugo+rw Jul 11 18:06:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:26 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 Jul 11 18:06:26 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:27 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66" returned: 0 in 0.665s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" released by "_copy_volume_from_snapshot" :: held 8.321s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=113,cinder:INSERT=35,cinder:UPDATE=124,cinder:DELETE=9 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-f82c415e-00ad-4f47-8b16-72756a588d62" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-f82c415e-00ad-4f47-8b16-72756a588d62" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Deleting offline snapshot f82c415e-00ad-4f47-8b16-72756a588d62 of volume b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] snapshot_file for this snap is: volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d17e7-dd38-411a-9b28-91c20ae325b0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:27 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:27 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:28 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.760s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f5685d-6000-4163-82c5-3dac8ef967ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:06:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f7e61-15ec-4496-a4fc-88adc6a45062]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:28 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:28 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:28 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=145,cinder:SELECT=105,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:06:29 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:29 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:29 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Flow 'volume_create_manager' (850ee852-485f-4809-abbd-a90dc5fd6047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86024074-16b3-481d-acb4-245e6f9a06b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86024074-16b3-481d-acb4-245e6f9a06b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1655430178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363eb6db-a198-4c14-be76-f05de651cafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7faf4837164b548a792d04e5a4651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:30Z,use_quota=True,user_id='7f21a4a444ac4623bcda59cd670cb67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0f1274-7226-4f51-bdf8-93e44f201135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0f1274-7226-4f51-bdf8-93e44f201135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7457a24-e660-4d92-a1bf-09d38887eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7457a24-e660-4d92-a1bf-09d38887eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363eb6db-a198-4c14-be76-f05de651cafc', 'volume_name': 'volume-363eb6db-a198-4c14-be76-f05de651cafc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afb6c82-0982-4076-8797-82249247351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afb6c82-0982-4076-8797-82249247351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7affb3-c6cd-4f2c-a205-d11f25f7ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Volume 363eb6db-a198-4c14-be76-f05de651cafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363eb6db-a198-4c14-be76-f05de651cafc', 'volume_size': 1} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:29 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.786s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:29 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62 Jul 11 18:06:29 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:30 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee.f82c415e-00ad-4f47-8b16-72756a588d62" returned: 0 in 0.654s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-f82c415e-00ad-4f47-8b16-72756a588d62" released by "_delete_snapshot" :: held 3.047s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.992s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.999s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f2ba450-394a-4281-9504-17d2d902d6e4,created_at=2026-07-11T16:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-435967246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f2ba450-394a-4281-9504-17d2d902d6e4,host='devstack@QuobyteHD#QuobyteHD',id=294a87bd-78b4-41b6-a713-6475179a97f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:18Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d238b9d5-0bd0-48c7-aa74-941eb5f59357),volume_type_id=d238b9d5-0bd0-48c7-aa74-941eb5f59357)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Creating volume 294a87bd-78b4-41b6-a713-6475179a97f7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2240b-2ab6-4e5e-b045-c054f232c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2328f5e-54df-4983-a18b-478fbecb4c66', 'volume_size': 1, 'source_volid': 'b7f5685d-6000-4163-82c5-3dac8ef967ee', 'source_volstatus': 'available'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:30 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 1073741824 Jul 11 18:06:30 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348b99c9-5731-4c57-b196-430f00d1d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Volume volume-c2328f5e-54df-4983-a18b-478fbecb4c66 (c2328f5e-54df-4983-a18b-478fbecb4c66): created successfully Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348b99c9-5731-4c57-b196-430f00d1d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (5ed21637-c2c7-438e-b759-981af979e1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c4a7526a-3823-40f7-892f-5ae777ad6421 tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:31 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 1073741824" returned: 0 in 0.810s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:31 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 Jul 11 18:06:31 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:32 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7" returned: 0 in 0.680s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1655430178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363eb6db-a198-4c14-be76-f05de651cafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7faf4837164b548a792d04e5a4651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:30Z,use_quota=True,user_id='7f21a4a444ac4623bcda59cd670cb67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Creating volume 363eb6db-a198-4c14-be76-f05de651cafc {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:32 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:32 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc 1073741824 Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3de59-09ad-4420-8f60-3bc97dcd38bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294a87bd-78b4-41b6-a713-6475179a97f7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e524714e-62b0-4680-8b69-4e320c3ae673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Volume volume-294a87bd-78b4-41b6-a713-6475179a97f7 (294a87bd-78b4-41b6-a713-6475179a97f7): created successfully Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e524714e-62b0-4680-8b69-4e320c3ae673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (07f1c732-ddf3-46d1-8971-5e897eafdd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7291cec5-8c61-41b5-8f09-84a7aca36b01 tempest-GroupsTest-667400971 None] Created volume successfully. Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (c19af9e7-f99a-46c8-9cc1-20aa8030d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc18d13d-26fa-4ed2-a846-51b87c011794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc18d13d-26fa-4ed2-a846-51b87c011794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-48500052',display_name='tempest-VolumesGetTest-Volume-893995030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf94414-a01d-465d-9fdf-4666a64551cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:32Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9f7bdc-bc92-4aa8-8aea-6e6afcaccd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9f7bdc-bc92-4aa8-8aea-6e6afcaccd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ac5773-c4b7-4ad5-ae48-fc17241ac7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ac5773-c4b7-4ad5-ae48-fc17241ac7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf94414-a01d-465d-9fdf-4666a64551cb', 'volume_name': 'volume-9bf94414-a01d-465d-9fdf-4666a64551cb', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f1c53c-9034-4aeb-a91f-4f17d6c8a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f1c53c-9034-4aeb-a91f-4f17d6c8a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81bb08b-64a6-4436-b2dc-ed8efcc84780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Volume 9bf94414-a01d-465d-9fdf-4666a64551cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf94414-a01d-465d-9fdf-4666a64551cb', 'volume_size': 1} Jul 11 18:06:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:33 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc 1073741824" returned: 0 in 0.858s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:33 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc Jul 11 18:06:33 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:33 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (5f28e813-a990-474f-93f6-20151981ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d75a1b-8d9e-4cea-b1ee-ba6cbf78d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc" returned: 0 in 0.699s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-48500052',display_name='tempest-VolumesGetTest-Volume-893995030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf94414-a01d-465d-9fdf-4666a64551cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:32Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Creating volume 9bf94414-a01d-465d-9fdf-4666a64551cb {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:33 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d75a1b-8d9e-4cea-b1ee-ba6cbf78d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635461267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f2ba450-394a-4281-9504-17d2d902d6e4,host='devstack@QuobyteHD#QuobyteHD',id=629c90db-1b39-46cb-97b3-fff7df649cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:34Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d238b9d5-0bd0-48c7-aa74-941eb5f59357),volume_type_id=d238b9d5-0bd0-48c7-aa74-941eb5f59357)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb 1073741824 Jul 11 18:06:33 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c3731c-3534-4578-82a8-5639e5addf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c3731c-3534-4578-82a8-5639e5addf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7952ecca-fa6c-4bcb-9e2f-2b46930b94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7952ecca-fa6c-4bcb-9e2f-2b46930b94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629c90db-1b39-46cb-97b3-fff7df649cca', 'volume_name': 'volume-629c90db-1b39-46cb-97b3-fff7df649cca', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e7953b-ce55-4cee-8db4-560462fd32d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e7953b-ce55-4cee-8db4-560462fd32d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabc1e73-be32-4ad9-ac6e-50f37040ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Volume 629c90db-1b39-46cb-97b3-fff7df649cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629c90db-1b39-46cb-97b3-fff7df649cca', 'volume_size': 1} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7affb3-c6cd-4f2c-a205-d11f25f7ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363eb6db-a198-4c14-be76-f05de651cafc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d8400d-4865-48b4-9cc8-3c1a0fa9b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Volume volume-363eb6db-a198-4c14-be76-f05de651cafc (363eb6db-a198-4c14-be76-f05de651cafc): created successfully Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d8400d-4865-48b4-9cc8-3c1a0fa9b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Flow 'volume_create_manager' (850ee852-485f-4809-abbd-a90dc5fd6047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7aea8216-5c5c-47be-ad54-5f9dd08161fc tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Created volume successfully. Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:34 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:34 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:34 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb 1073741824" returned: 0 in 0.859s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:34 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb Jul 11 18:06:34 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:34 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.676s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:06:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:06:35 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb" returned: 0 in 0.632s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f2ba450-394a-4281-9504-17d2d902d6e4,created_at=2026-07-11T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635461267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f2ba450-394a-4281-9504-17d2d902d6e4,host='devstack@QuobyteHD#QuobyteHD',id=629c90db-1b39-46cb-97b3-fff7df649cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ac2a007b6744fda84efd9a88a9cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:34Z,use_quota=True,user_id='383f14c7d8dd4e6fb28b394a07f6a31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d238b9d5-0bd0-48c7-aa74-941eb5f59357),volume_type_id=d238b9d5-0bd0-48c7-aa74-941eb5f59357)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Creating volume 629c90db-1b39-46cb-97b3-fff7df649cca {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:35 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81bb08b-64a6-4436-b2dc-ed8efcc84780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf94414-a01d-465d-9fdf-4666a64551cb', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:35 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca 1073741824 Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5300877e-7a8d-4721-8305-082fff804274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:35 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Volume volume-9bf94414-a01d-465d-9fdf-4666a64551cb (9bf94414-a01d-465d-9fdf-4666a64551cb): created successfully Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5300877e-7a8d-4721-8305-082fff804274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (c19af9e7-f99a-46c8-9cc1-20aa8030d301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fedd563e-d3a0-429d-84b5-abb19caeba25 tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-9bf94414-a01d-465d-9fdf-4666a64551cb-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "cinder-9bf94414-a01d-465d-9fdf-4666a64551cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-9bf94414-a01d-465d-9fdf-4666a64551cb" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-9bf94414-a01d-465d-9fdf-4666a64551cb" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbda469-4581-4889-8317-48cd365d46b5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:35 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb Jul 11 18:06:35 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:36 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca 1073741824" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:36 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca Jul 11 18:06:36 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:36 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:36 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb Jul 11 18:06:36 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:36 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabc1e73-be32-4ad9-ac6e-50f37040ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629c90db-1b39-46cb-97b3-fff7df649cca', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660fd3cc-ef78-4f64-ae5d-b0d32a0ed237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:36 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Volume volume-629c90db-1b39-46cb-97b3-fff7df649cca (629c90db-1b39-46cb-97b3-fff7df649cca): created successfully Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660fd3cc-ef78-4f64-ae5d-b0d32a0ed237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Flow 'volume_create_manager' (5f28e813-a990-474f-93f6-20151981ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7fdd3051-461d-47b3-8f97-6ea0d414cc70 tempest-GroupsTest-667400971 None] Created volume successfully. Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe294e45-1a1a-4624-9c5a-243ec8fbfb7e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:37 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc Jul 11 18:06:37 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:37 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9bf94414-a01d-465d-9fdf-4666a64551cb" returned: 0 in 0.705s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-9bf94414-a01d-465d-9fdf-4666a64551cb" released by "delete_volume" :: held 1.538s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a35f5c0d-a304-4422-af59-aa196a95a29f tempest-GroupsTest-667400971 None] Update group completed successfully. Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Created reservations ['71db8790-10a2-4081-8ef7-7ec62109fca3', 'd1b0d697-e92a-49db-a5f2-b818b187db4d', '409e3841-fc98-4e70-a010-2e1f70c5ee30', '49aae25c-47a0-441f-b9a9-1615d2f13efa'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:37 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:37 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:37 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc" returned: 0 in 0.799s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-363eb6db-a198-4c14-be76-f05de651cafc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4954baef-3984-43c8-a521-1387c36d74e3', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-c2328f5e-54df-4983-a18b-478fbecb4c66-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "cinder-c2328f5e-54df-4983-a18b-478fbecb4c66-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-8074ffbb-1eeb-4072-bfa5-a845ef8eae11 req-6505046a-61f2-4f63-a8f3-d66cc752c595 tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] attachment_update completed successfully. Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:38 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f4f32-bc76-4bbd-a746-09c41b1364ad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.712s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-52610112-7442-4bde-8b4f-5699c254de39 tempest-VolumesGetTest-1731128797 None] Lock "cinder-9bf94414-a01d-465d-9fdf-4666a64551cb-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:38 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 Jul 11 18:06:38 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-66b41583-500f-4523-a12a-4cf6b6e71da2 tempest-GroupsTest-667400971 None] Update group completed successfully. Jul 11 18:06:38 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66" returned: 0 in 0.807s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:39 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66 Jul 11 18:06:39 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:39 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2328f5e-54df-4983-a18b-478fbecb4c66" returned: 0 in 0.667s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-c2328f5e-54df-4983-a18b-478fbecb4c66" released by "delete_volume" :: held 1.531s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Created reservations ['7cded510-5901-4004-9e23-a6aee17222dc', 'f17fbc72-293a-4ae5-bab8-c7c7ffe774d8', '377e1569-f6fa-45de-875e-22c935b38802', '69eaea0c-210a-4720-9c66-f1844b28b42f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:39 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:39 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-b7f5685d-6000-4163-82c5-3dac8ef967ee-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "cinder-b7f5685d-6000-4163-82c5-3dac8ef967ee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Acquiring lock "cinder-quobyte-294a87bd-78b4-41b6-a713-6475179a97f7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-294a87bd-78b4-41b6-a713-6475179a97f7" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-b7f5685d-6000-4163-82c5-3dac8ef967ee" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-b7f5685d-6000-4163-82c5-3dac8ef967ee" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67314b-0499-4069-af31-857b3ad552c9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277ba47-9bd6-4de3-801b-06c84189d063]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:40 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:06:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1588386b-1703-4694-b636-6b2818dbe978 tempest-VolumesGetTest-1731128797 None] Lock "cinder-c2328f5e-54df-4983-a18b-478fbecb4c66-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:40 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 Jul 11 18:06:40 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:40 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:40 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:41 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7" returned: 0 in 0.805s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:41 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.813s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:41 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7 Jul 11 18:06:41 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:41 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee Jul 11 18:06:41 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:42 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-294a87bd-78b4-41b6-a713-6475179a97f7" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:42 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b7f5685d-6000-4163-82c5-3dac8ef967ee" returned: 0 in 0.683s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-294a87bd-78b4-41b6-a713-6475179a97f7" released by "delete_volume" :: held 1.593s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Acquiring lock "cinder-quobyte-629c90db-1b39-46cb-97b3-fff7df649cca" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-b7f5685d-6000-4163-82c5-3dac8ef967ee" released by "delete_volume" :: held 1.567s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-629c90db-1b39-46cb-97b3-fff7df649cca" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc25108-5201-4c21-b5a6-24c2dcdd5070]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Created reservations ['8f6ea8af-b058-4ade-956b-f1a990eb3e0a', 'e76ef087-d337-4d27-97c5-77786e29f7c7', 'd8c03e75-2573-41f4-8088-cb3bd71fc96b', 'c9fdac7f-f4c2-4392-ae23-a73d40a92072'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:42 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca Jul 11 18:06:42 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:42 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:42 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:43 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca" returned: 0 in 1.018s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:43 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.880s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:06:43 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca Jul 11 18:06:43 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c371f47-cbb1-45d6-adf7-f36a8db1d6bb tempest-VolumesGetTest-1731128797 None] Lock "cinder-b7f5685d-6000-4163-82c5-3dac8ef967ee-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (7367d2cd-9c7a-4818-bbbb-99458f44aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0ab27a-9c04-4b46-b16a-53bfec904b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0ab27a-9c04-4b46-b16a-53bfec904b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1797293534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e7e881-81fe-4743-ba69-97ba2caba0a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:44Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33b7d5e-bd19-4b04-9ad2-d043d41f6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33b7d5e-bd19-4b04-9ad2-d043d41f6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e7abc6-185e-45d9-8182-9a6e855b5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:06:43 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-629c90db-1b39-46cb-97b3-fff7df649cca" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "cinder-quobyte-629c90db-1b39-46cb-97b3-fff7df649cca" released by "delete_volume" :: held 1.819s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Created reservations ['15b511af-2769-4aaa-a756-d563cf09df9f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e7abc6-185e-45d9-8182-9a6e855b5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5e7e881-81fe-4743-ba69-97ba2caba0a0', 'volume_name': 'volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8179904-4bfb-4434-8d23-a456d9a606bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8179904-4bfb-4434-8d23-a456d9a606bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccdbb7b-0042-4087-9dfb-44f54bb75ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:44 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Volume b5e7e881-81fe-4743-ba69-97ba2caba0a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Trying to clone b5e7e881-81fe-4743-ba69-97ba2caba0a0 from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:06:44 devstack cinder-volume[86932]: WARNING cinder.quota [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2084679569 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2084679569, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:06:44 devstack cinder-volume[86932]: WARNING cinder.quota [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2084679569 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2084679569, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Created reservations ['f98dd3b0-238b-4d72-be06-6dd528de7161', '239fbe7e-08ed-4a5b-aead-91297707fde3', 'ad551d99-1af2-48e8-b752-c8d19267c40e', '0a3d3361-e6dd-4b8e-8730-a1204fa39b14'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Created reservations ['f6cc571b-4c96-4dd0-a0cc-7f2fbbd40332', 'bdc674e2-fb83-4bd9-9950-48478ff1576f', '519ef4cb-090c-4f4a-b60d-fb5b2bcc25fd', 'cb249c57-6903-4cf8-a9d9-3c5d7cf848f6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:06:44 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:44 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:44 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ba146-1507-48b3-9b63-22f9060edfef]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:44 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD Jul 11 18:06:44 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-2c2ee920-e155-456d-88dc-a9a9dbf75f2f req-46aca3f7-a053-4b69-a632-f38099992e8c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Terminate volume connection completed successfully. Jul 11 18:06:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-2c2ee920-e155-456d-88dc-a9a9dbf75f2f req-46aca3f7-a053-4b69-a632-f38099992e8c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Deleting attachment 4954baef-3984-43c8-a521-1387c36d74e3. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:06:45 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9722f07a-1e74-4eba-a625-3ce784a0eddd tempest-GroupsTest-667400971 None] Delete group completed successfully. Jul 11 18:06:45 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 is fetched for user 4430a8d9bc9242958a815ec889e1853b. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae97712-a26b-4b10-9061-36cbd2c4b494]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:45 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD Jul 11 18:06:45 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:46 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1797293534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e7e881-81fe-4743-ba69-97ba2caba0a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:44Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Creating volume b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:46 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:46 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1073741824 Jul 11 18:06:46 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "cinder-363eb6db-a198-4c14-be76-f05de651cafc-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "cinder-363eb6db-a198-4c14-be76-f05de651cafc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "cinder-quobyte-363eb6db-a198-4c14-be76-f05de651cafc" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "cinder-quobyte-363eb6db-a198-4c14-be76-f05de651cafc" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f61aa8-4afc-4daf-8597-4b22518e1828]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:46 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1073741824" returned: 0 in 0.951s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:47 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:06:47 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:47 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc Jul 11 18:06:47 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:47 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:47 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc" returned: 0 in 0.857s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:47 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Attempting download of 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume b5e7e881-81fe-4743-ba69-97ba2caba0a0. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:06:47 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353a1db-cdee-479e-8f2c-0e78ae8c60ec]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:48 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj Jul 11 18:06:48 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:48 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-363eb6db-a198-4c14-be76-f05de651cafc" returned: 0 in 0.760s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "cinder-quobyte-363eb6db-a198-4c14-be76-f05de651cafc" released by "delete_volume" :: held 1.666s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Created reservations ['c2d5ec65-99d2-4123-9381-23d97dde67fb', '9da513ef-75d1-4f12-82f2-d8003fc46a9f', '024b001f-5d97-433c-9b4a-b87c04c690a2', 'a470c33c-6c51-409f-99e1-e3a7920e2c51'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:48 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:06:48 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:48 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj" returned: 0 in 0.844s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:48 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj Jul 11 18:06:48 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:49 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.753s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:06:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Deleted volume successfully. Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5176befb-2a9f-4ba3-9a34-12c281ca573c tempest-TestServerVolumeAttachScenarioOldVersion-659136290 None] Lock "cinder-363eb6db-a198-4c14-be76-f05de651cafc-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:06:49 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj" returned: 1 in 0.833s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_pmm22wqj' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13f14e3-e7ed-47ed-a21a-c4084e2f1b5b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:49 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD Jul 11 18:06:49 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:50 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:50 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 was qcow2, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:06:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:50 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:06:50 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:52 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 0 in 2.474s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:52 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_w9f09guhdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:06:52 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Converted 112.00 MB image at 45.24 MB/s Jul 11 18:06:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:52 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1G Jul 11 18:06:52 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:53 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 1G" returned: 0 in 0.761s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa5c160-00e5-44b3-8f83-a32112f1912e]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:53 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:06:53 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:54 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:54 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:06:54 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:55 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 1 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Downloaded image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume b5e7e881-81fe-4743-ba69-97ba2caba0a0 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 for user 4430a8d9bc9242958a815ec889e1853b is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Marking volume b5e7e881-81fe-4743-ba69-97ba2caba0a0 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Copying metadata from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 to b5e7e881-81fe-4743-ba69-97ba2caba0a0. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Creating volume glance metadata for volume b5e7e881-81fe-4743-ba69-97ba2caba0a0 backed by image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccdbb7b-0042-4087-9dfb-44f54bb75ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d0056e-4e43-4d41-ae73-c5393674556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Volume volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 (b5e7e881-81fe-4743-ba69-97ba2caba0a0): created successfully Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d0056e-4e43-4d41-ae73-c5393674556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (7367d2cd-9c7a-4818-bbbb-99458f44aacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-217f45c0-fb95-4c8e-9255-3e5467def2f1 tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (5b39043d-cf17-4c3e-aec5-bb604daec6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51653b97-c273-4aa8-87cd-94da4c2df93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51653b97-c273-4aa8-87cd-94da4c2df93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-173825708',display_name='tempest-VolumesGetTest-Volume-1120455693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988b32e8-f41c-4f1f-ac3d-cf2c576afae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:57Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d75c5-169d-44f8-9cc1-0cb01b533324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d75c5-169d-44f8-9cc1-0cb01b533324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e5a6f3-be72-4d09-80d1-699426a15cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e5a6f3-be72-4d09-80d1-699426a15cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988b32e8-f41c-4f1f-ac3d-cf2c576afae2', 'volume_name': 'volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8335500-6f8f-4f39-b08f-cee3f1fb7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8335500-6f8f-4f39-b08f-cee3f1fb7817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa2a973-a03c-4a46-9059-beb2a1a39a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Volume 988b32e8-f41c-4f1f-ac3d-cf2c576afae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2', 'volume_size': 1} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:06:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-173825708',display_name='tempest-VolumesGetTest-Volume-1120455693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988b32e8-f41c-4f1f-ac3d-cf2c576afae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3743e77612ed444e95fee1589b9bc851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:06:57Z,use_quota=True,user_id='4430a8d9bc9242958a815ec889e1853b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Creating volume 988b32e8-f41c-4f1f-ac3d-cf2c576afae2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:06:57 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:06:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:57 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 1073741824 Jul 11 18:06:57 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:58 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 1073741824" returned: 0 in 0.996s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:58 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 Jul 11 18:06:58 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:06:59 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa2a973-a03c-4a46-9059-beb2a1a39a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8a6feb-ae20-411e-bd78-7bc6f9b45aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:06:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Volume volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 (988b32e8-f41c-4f1f-ac3d-cf2c576afae2): created successfully Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8a6feb-ae20-411e-bd78-7bc6f9b45aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Flow 'volume_create_manager' (5b39043d-cf17-4c3e-aec5-bb604daec6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:06:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-50f204db-fed2-4ea5-9469-8b555a3ff3cc tempest-VolumesGetTest-1731128797 None] Created volume successfully. Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-988b32e8-f41c-4f1f-ac3d-cf2c576afae2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "cinder-988b32e8-f41c-4f1f-ac3d-cf2c576afae2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c4bd46-f1b1-4060-a53c-25bb664530e6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:06:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:06:59 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 Jul 11 18:06:59 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:00 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" returned: 0 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:00 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2 Jul 11 18:07:00 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:01 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-988b32e8-f41c-4f1f-ac3d-cf2c576afae2" released by "delete_volume" :: held 1.679s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Created reservations ['7d4531ca-6c7b-40c7-a26b-df13285135d4', '32d9ada4-1048-4f67-bf11-f746640afb24', 'a6d74f45-93b3-493e-88bc-6aac33a744fe', 'ac69aa78-6ae3-4588-9897-5cb0f0a01ce5'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:01 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:01 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (2c944f78-ea6e-4dc4-9d85-e41f9116f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a7ee62-147f-4f6a-8f19-1518040ed522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a7ee62-147f-4f6a-8f19-1518040ed522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1212246034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b65987f-b37c-4464-9297-991033ab1684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:02Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58805acc-a525-4573-b989-d6205e35cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58805acc-a525-4573-b989-d6205e35cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ee9538-66aa-4ca5-b4d2-869ff3b0d032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ee9538-66aa-4ca5-b4d2-869ff3b0d032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b65987f-b37c-4464-9297-991033ab1684', 'volume_name': 'volume-8b65987f-b37c-4464-9297-991033ab1684', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6328a8bf-290b-4e9f-bb85-d90ddc5cb004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6328a8bf-290b-4e9f-bb85-d90ddc5cb004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75761095-88dd-463f-ab54-dfb1061b5d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Volume 8b65987f-b37c-4464-9297-991033ab1684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b65987f-b37c-4464-9297-991033ab1684', 'volume_size': 1} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1212246034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b65987f-b37c-4464-9297-991033ab1684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:02Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Creating volume 8b65987f-b37c-4464-9297-991033ab1684 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:01 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-b5e7e881-81fe-4743-ba69-97ba2caba0a0-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "cinder-b5e7e881-81fe-4743-ba69-97ba2caba0a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:01 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 1073741824 Jul 11 18:07:01 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Acquiring lock "cinder-quobyte-b5e7e881-81fe-4743-ba69-97ba2caba0a0" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-b5e7e881-81fe-4743-ba69-97ba2caba0a0" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce3c867-de36-4eb0-9a75-07b593a5b7de]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:02 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:07:02 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:02 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.809s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b44d7d3-0965-473f-b3c8-28936edda343 tempest-VolumesGetTest-1731128797 None] Lock "cinder-988b32e8-f41c-4f1f-ac3d-cf2c576afae2-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:02 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 1073741824" returned: 0 in 0.964s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:02 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 Jul 11 18:07:02 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:02 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 0 in 0.878s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:03 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:07:03 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:03 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684" returned: 0 in 0.717s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75761095-88dd-463f-ab54-dfb1061b5d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b65987f-b37c-4464-9297-991033ab1684', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dba591-0062-4fd5-87bf-fcff8b56a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Volume volume-8b65987f-b37c-4464-9297-991033ab1684 (8b65987f-b37c-4464-9297-991033ab1684): created successfully Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dba591-0062-4fd5-87bf-fcff8b56a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (2c944f78-ea6e-4dc4-9d85-e41f9116f766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-437d36e9-6b32-4245-bfbd-fc194978314e tempest-VolumesListAdminTestJSON-36987397 None] Created volume successfully. Jul 11 18:07:03 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 1 in 0.848s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:03 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0 Jul 11 18:07:03 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (ace031da-203e-4552-b98e-d7ecae4e97d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1980ac7c-1256-4eb5-9244-0faaa4f936cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1980ac7c-1256-4eb5-9244-0faaa4f936cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1809586278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc37dd4-4687-4824-b6b3-361e24f5e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:04Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8f6ea-bd28-411e-abe9-0b8f881528fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8f6ea-bd28-411e-abe9-0b8f881528fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d14646e-ee3d-40e3-b07e-50acfcf1a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d14646e-ee3d-40e3-b07e-50acfcf1a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc37dd4-4687-4824-b6b3-361e24f5e1c9', 'volume_name': 'volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ff301d-753d-40aa-b116-b054cee5b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ff301d-753d-40aa-b116-b054cee5b527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b6ca3-a7eb-45f6-88d1-d92967f9aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Volume ccc37dd4-4687-4824-b6b3-361e24f5e1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9', 'volume_size': 1} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1809586278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc37dd4-4687-4824-b6b3-361e24f5e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:04Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Creating volume ccc37dd4-4687-4824-b6b3-361e24f5e1c9 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:04 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:04 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 1073741824 Jul 11 18:07:04 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:04 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b5e7e881-81fe-4743-ba69-97ba2caba0a0" returned: 0 in 0.739s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "cinder-quobyte-b5e7e881-81fe-4743-ba69-97ba2caba0a0" released by "delete_volume" :: held 2.567s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Created reservations ['3d6034d4-ddfe-4b85-a958-e496891f8616', '518d6678-4638-4640-84c5-b23177ea66f7', '733816fb-73f6-4d7e-8aa7-9cc4e1b68b10', '951499bd-915e-49ce-8f91-c4b4fdc3d759'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:04 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:04 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:05 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 1073741824" returned: 0 in 1.067s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:05 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:05 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Deleted volume successfully. Jul 11 18:07:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0dda306-c835-416f-9494-ffe418321889 tempest-VolumesGetTest-1731128797 None] Lock "cinder-b5e7e881-81fe-4743-ba69-97ba2caba0a0-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:05 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 Jul 11 18:07:05 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:06 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" returned: 0 in 0.725s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b6ca3-a7eb-45f6-88d1-d92967f9aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dc7b9a-d808-405d-96ae-b0bc45f7443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:06 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Volume volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 (ccc37dd4-4687-4824-b6b3-361e24f5e1c9): created successfully Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dc7b9a-d808-405d-96ae-b0bc45f7443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (ace031da-203e-4552-b98e-d7ecae4e97d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4cace4b0-feaa-4bb4-a5f4-c58f2eca6d45 tempest-VolumesListAdminTestJSON-36987397 None] Created volume successfully. Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (825968ca-c829-400e-ae36-a99a41a8f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effa0c7b-42e2-41c7-b33d-1ee6b29d4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effa0c7b-42e2-41c7-b33d-1ee6b29d4c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1493755672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca02fe85-71d7-4734-825d-95ea392717a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:07Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d978677f-215e-43b6-a5b9-199410ffe474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d978677f-215e-43b6-a5b9-199410ffe474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ff4fd-50f1-48f6-844d-20d8b217bac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ff4fd-50f1-48f6-844d-20d8b217bac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca02fe85-71d7-4734-825d-95ea392717a1', 'volume_name': 'volume-ca02fe85-71d7-4734-825d-95ea392717a1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09e1b57-a585-4c4d-865e-51c3a6adb291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09e1b57-a585-4c4d-865e-51c3a6adb291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10d2856-c881-4e46-be7e-07d31ecf111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Volume ca02fe85-71d7-4734-825d-95ea392717a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca02fe85-71d7-4734-825d-95ea392717a1', 'volume_size': 1} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1493755672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca02fe85-71d7-4734-825d-95ea392717a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f65e9ed31b4a219f3b7a77e75674b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:07Z,use_quota=True,user_id='5fc5685098424dd6907293e2cea6496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Creating volume ca02fe85-71d7-4734-825d-95ea392717a1 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:07 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:07 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 1073741824 Jul 11 18:07:07 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:08 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 1073741824" returned: 0 in 0.946s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:08 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 Jul 11 18:07:08 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:08 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1" returned: 0 in 0.688s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10d2856-c881-4e46-be7e-07d31ecf111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca02fe85-71d7-4734-825d-95ea392717a1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e82613-c8c5-4017-aaed-cebd8c813195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (f3372145-1439-4ee8-984b-364ce6f79cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efd122d-0c5e-448c-b7ac-76f4eed1783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Volume volume-ca02fe85-71d7-4734-825d-95ea392717a1 (ca02fe85-71d7-4734-825d-95ea392717a1): created successfully Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e82613-c8c5-4017-aaed-cebd8c813195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Flow 'volume_create_manager' (825968ca-c829-400e-ae36-a99a41a8f607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efd122d-0c5e-448c-b7ac-76f4eed1783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1382142857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e3ac26-351e-4351-b0c1-b9cde3e39425,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:09Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4eec00-7b59-4698-b72c-d8cdd90034dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4eec00-7b59-4698-b72c-d8cdd90034dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9eba2b-24eb-4aa0-8f6b-fb5eb1329fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9eba2b-24eb-4aa0-8f6b-fb5eb1329fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e3ac26-351e-4351-b0c1-b9cde3e39425', 'volume_name': 'volume-37e3ac26-351e-4351-b0c1-b9cde3e39425', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed638e2-3395-4e75-bdf5-440faa8a4c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed638e2-3395-4e75-bdf5-440faa8a4c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ab0b39-dbcb-4660-83ee-7da32e4275d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Volume 37e3ac26-351e-4351-b0c1-b9cde3e39425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e3ac26-351e-4351-b0c1-b9cde3e39425', 'volume_size': 1} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1382142857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e3ac26-351e-4351-b0c1-b9cde3e39425,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:09Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Creating volume 37e3ac26-351e-4351-b0c1-b9cde3e39425 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:09 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d21f8524-ece3-46c5-a5a7-d2193f8d67f0 tempest-VolumesListAdminTestJSON-36987397 None] Created volume successfully. Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:09 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 1073741824 Jul 11 18:07:09 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Flow 'volume_create_manager' (5c62e270-91e2-4423-8f7a-2b2a3fbecba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a7ad84-8636-4da4-8e9c-18e8dc133ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a7ad84-8636-4da4-8e9c-18e8dc133ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-8150127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93593ede-5049-4291-844f-8a8c39840582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100203253b6641fcb55fb45775012435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:09Z,use_quota=True,user_id='7b34c854757547c1b1ca3aaf4e87a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14229121-0eea-45db-a185-5db302da8d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14229121-0eea-45db-a185-5db302da8d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0269e6d-0891-48fc-886d-736323254280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0269e6d-0891-48fc-886d-736323254280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93593ede-5049-4291-844f-8a8c39840582', 'volume_name': 'volume-93593ede-5049-4291-844f-8a8c39840582', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201c306-8958-4b64-895d-2f7c1b506ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201c306-8958-4b64-895d-2f7c1b506ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b64509d-7d64-40c6-8637-ab9f3d3272c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Volume 93593ede-5049-4291-844f-8a8c39840582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93593ede-5049-4291-844f-8a8c39840582', 'volume_size': 1} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:09 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Flow 'volume_create_manager' (90eea6ca-275f-4017-8750-620dc44cb59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98121800-e258-4501-808d-8119af0d6162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 1073741824" returned: 0 in 0.888s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98121800-e258-4501-808d-8119af0d6162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e92fd6-c15d-4a11-affd-aa57edc5afbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1cb2381154c24818d4c58b8347f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:10Z,use_quota=True,user_id='2bce64bd54ab4278b529bf1b6fc3df6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb743400-a9d2-48f7-b851-a9c21f21e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb743400-a9d2-48f7-b851-a9c21f21e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955fbbc-3832-4833-934c-e58d181739d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955fbbc-3832-4833-934c-e58d181739d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e92fd6-c15d-4a11-affd-aa57edc5afbc', 'volume_name': 'volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6608c191-45a4-43b8-9db3-637acbc2d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6608c191-45a4-43b8-9db3-637acbc2d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b840bef1-c200-4d36-9f22-72c1c6cee9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Volume b1e92fd6-c15d-4a11-affd-aa57edc5afbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc', 'volume_size': 1} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:10 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 Jul 11 18:07:10 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:10 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425" returned: 0 in 0.634s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-8150127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93593ede-5049-4291-844f-8a8c39840582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100203253b6641fcb55fb45775012435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:09Z,use_quota=True,user_id='7b34c854757547c1b1ca3aaf4e87a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Creating volume 93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:10 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:10 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 1073741824 Jul 11 18:07:10 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ab0b39-dbcb-4660-83ee-7da32e4275d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e3ac26-351e-4351-b0c1-b9cde3e39425', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e295ac-5768-4104-83d8-51e92a25aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Volume volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 (37e3ac26-351e-4351-b0c1-b9cde3e39425): created successfully Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e295ac-5768-4104-83d8-51e92a25aee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (f3372145-1439-4ee8-984b-364ce6f79cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9bbb2ef7-54ff-4bd4-b180-fe1e326fe337 tempest-VolumesListTestJSON-373088715 None] Created volume successfully. Jul 11 18:07:11 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 1073741824" returned: 0 in 0.806s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:11 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:11 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:12 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.647s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e92fd6-c15d-4a11-affd-aa57edc5afbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1cb2381154c24818d4c58b8347f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:10Z,use_quota=True,user_id='2bce64bd54ab4278b529bf1b6fc3df6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Creating volume b1e92fd6-c15d-4a11-affd-aa57edc5afbc {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:12 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b64509d-7d64-40c6-8637-ab9f3d3272c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93593ede-5049-4291-844f-8a8c39840582', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baefcef-210d-44f4-9f4d-be6a0b442542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc 1073741824 Jul 11 18:07:12 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Volume volume-93593ede-5049-4291-844f-8a8c39840582 (93593ede-5049-4291-844f-8a8c39840582): created successfully Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baefcef-210d-44f4-9f4d-be6a0b442542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Flow 'volume_create_manager' (5c62e270-91e2-4423-8f7a-2b2a3fbecba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f2069ddc-429c-4611-b74a-9e8259dfc251 tempest-VolumeDependencyTests-1876859488 None] Created volume successfully. Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (0f63d12a-9b60-47a5-9014-08ca666fe857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b4c6c8-6565-4a7f-b8e2-de2afcbf171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b4c6c8-6565-4a7f-b8e2-de2afcbf171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1547655683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6ce26f-2542-45b0-a190-981b40661e0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:12Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55039a13-6ae5-4036-b41a-6f7f4b23b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55039a13-6ae5-4036-b41a-6f7f4b23b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b1c44-9a47-4c83-bbbd-35389dee4c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b1c44-9a47-4c83-bbbd-35389dee4c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6ce26f-2542-45b0-a190-981b40661e0e', 'volume_name': 'volume-0f6ce26f-2542-45b0-a190-981b40661e0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d52266-0144-40e9-8f43-5ea36f2d9b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d52266-0144-40e9-8f43-5ea36f2d9b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03e632c-1b34-41b9-b4db-01ba8c1b6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Volume 0f6ce26f-2542-45b0-a190-981b40661e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6ce26f-2542-45b0-a190-981b40661e0e', 'volume_size': 1} Jul 11 18:07:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:13 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc 1073741824" returned: 0 in 0.836s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:13 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc Jul 11 18:07:13 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:13 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" returned: 0 in 0.676s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1547655683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6ce26f-2542-45b0-a190-981b40661e0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:12Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Creating volume 0f6ce26f-2542-45b0-a190-981b40661e0e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:13 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:13 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e 1073741824 Jul 11 18:07:13 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b840bef1-c200-4d36-9f22-72c1c6cee9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d1eb0-4a99-4647-9763-695efc4ca340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:13 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Volume volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc (b1e92fd6-c15d-4a11-affd-aa57edc5afbc): created successfully Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d1eb0-4a99-4647-9763-695efc4ca340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Flow 'volume_create_manager' (90eea6ca-275f-4017-8750-620dc44cb59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-028ab267-6138-4006-8ae1-12652c788845 tempest-VolumesListAdminTestJSON-427316766 None] Created volume successfully. Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Acquiring lock "cinder-b1e92fd6-c15d-4a11-affd-aa57edc5afbc-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "cinder-b1e92fd6-c15d-4a11-affd-aa57edc5afbc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Acquiring lock "cinder-quobyte-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "cinder-quobyte-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fa4cfa-c160-4768-b093-397031e6c839]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-ca02fe85-71d7-4734-825d-95ea392717a1-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-ca02fe85-71d7-4734-825d-95ea392717a1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-quobyte-ca02fe85-71d7-4734-825d-95ea392717a1" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-ca02fe85-71d7-4734-825d-95ea392717a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:14 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc Jul 11 18:07:14 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c9ba94-7049-454f-871e-c509cb1870c1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:14 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 Jul 11 18:07:14 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:14 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e 1073741824" returned: 0 in 0.941s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:14 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e Jul 11 18:07:14 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:15 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" returned: 0 in 0.900s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:15 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc Jul 11 18:07:15 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:15 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1" returned: 0 in 0.799s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:15 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1 Jul 11 18:07:15 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:15 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e" returned: 0 in 0.671s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.197s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Creating offline snapshot 482a39a5-a850-4888-8565-8c0d39c9c182 of volume 93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03e632c-1b34-41b9-b4db-01ba8c1b6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6ce26f-2542-45b0-a190-981b40661e0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6e657-13c8-4057-b824-53df0c51c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61f750-f276-4062-9337-213d2d3d3485]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:15 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Volume volume-0f6ce26f-2542-45b0-a190-981b40661e0e (0f6ce26f-2542-45b0-a190-981b40661e0e): created successfully Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6e657-13c8-4057-b824-53df0c51c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (0f63d12a-9b60-47a5-9014-08ca666fe857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-05defa17-0120-444f-8c13-871dcc00618a tempest-VolumesListTestJSON-373088715 None] Created volume successfully. Jul 11 18:07:15 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:15 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:15 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" returned: 0 in 0.674s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "cinder-quobyte-b1e92fd6-c15d-4a11-affd-aa57edc5afbc" released by "delete_volume" :: held 1.629s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:15 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Created reservations ['6826ba9b-16a1-4b94-8215-b7745de1379e', '3b75a05e-467a-44ef-bef8-5ccd6ca73b8b', 'cfc71bcd-7a30-4311-b705-c92ca519fd3a', 'e3b64154-f401-4835-98c8-fa6316160f9c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:16 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ca02fe85-71d7-4734-825d-95ea392717a1" returned: 0 in 0.720s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-ca02fe85-71d7-4734-825d-95ea392717a1" released by "delete_volume" :: held 1.562s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:16 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:16 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Created reservations ['cfbbc0f7-8e61-4758-88c6-8c73d9ce2f82', '6832f6fb-010d-408b-a1af-6739cc7b1159', 'd92be54a-cff1-42e2-9797-8303870754a9', 'cb64a2b9-cfd4-430a-9f67-ce3509d78ba2'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:16 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:16 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:16 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.821s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:16 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 1G Jul 11 18:07:16 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:16 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.733s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Deleted volume successfully. Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-ccc37dd4-4687-4824-b6b3-361e24f5e1c9-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-eb04b53b-0e34-405c-be65-f2312da07863 tempest-VolumesListAdminTestJSON-427316766 None] Lock "cinder-b1e92fd6-c15d-4a11-affd-aa57edc5afbc-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-ccc37dd4-4687-4824-b6b3-361e24f5e1c9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-quobyte-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:16 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Deleted volume successfully. Jul 11 18:07:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfd7a2-0f4e-4385-87dd-f3e9adaf590d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5127a9c-79d5-4366-a939-1dc0852c926b tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-ca02fe85-71d7-4734-825d-95ea392717a1-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:17 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 Jul 11 18:07:17 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:17 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 1G" returned: 0 in 0.982s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93593ede-5049-4291-844f-8a8c39840582 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:17 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93593ede-5049-4291-844f-8a8c39840582 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:17 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (f710b9a7-6fab-4533-9f9a-97ebe5ff118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c559774-48e1-442a-9e9b-dbefa18c9afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c559774-48e1-442a-9e9b-dbefa18c9afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-603275628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7f4a4b-db3b-45bc-bd88-675f24bc3363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:17Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9bde8b-d10f-4748-8ae8-e5fb2f92f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9bde8b-d10f-4748-8ae8-e5fb2f92f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ad5fff-a0e8-4e73-b7f0-467be2521042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ad5fff-a0e8-4e73-b7f0-467be2521042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7f4a4b-db3b-45bc-bd88-675f24bc3363', 'volume_name': 'volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f54f69-31ad-41db-8327-e90be2cbd83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f54f69-31ad-41db-8327-e90be2cbd83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dbfa74-2d22-4ced-b744-e8722d5451e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Volume 3f7f4a4b-db3b-45bc-bd88-675f24bc3363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363', 'volume_size': 1} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:17 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" returned: 0 in 0.831s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:17 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9 Jul 11 18:07:17 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:17 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93593ede-5049-4291-844f-8a8c39840582 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:17 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 is being set with open permissions: ugo+rw Jul 11 18:07:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:18 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:18 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:18 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-ccc37dd4-4687-4824-b6b3-361e24f5e1c9" released by "delete_volume" :: held 1.554s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Created reservations ['e9364926-816e-479d-a16b-c02487cc3867', 'f0ac69ec-3e92-4cda-8ed9-ee0ccaf05bd8', '5166123b-4ba5-4b22-adf8-00a0d89726ec', '16acf8bb-c8bc-4458-b50d-0afd075f800d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:18 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.653s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:18 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info Jul 11 18:07:18 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:18 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:18 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-8b65987f-b37c-4464-9297-991033ab1684-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-8b65987f-b37c-4464-9297-991033ab1684-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "cinder-quobyte-8b65987f-b37c-4464-9297-991033ab1684" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-8b65987f-b37c-4464-9297-991033ab1684" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340f278-3df8-45bf-bde9-154a77bda57f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:19 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info" returned: 0 in 0.673s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:19 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info is being set with open permissions: ugo+rw Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:19 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info Jul 11 18:07:19 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:19 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:19 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 Jul 11 18:07:19 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.690s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Deleted volume successfully. Jul 11 18:07:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-78c004ca-5f18-4365-805a-991044466930 tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-ccc37dd4-4687-4824-b6b3-361e24f5e1c9-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:20 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.info" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-603275628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7f4a4b-db3b-45bc-bd88-675f24bc3363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e5c44aaf2f74b3491af1509468952fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:17Z,use_quota=True,user_id='1a009d3f4d8944d7b65ba827ef550e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Creating volume 3f7f4a4b-db3b-45bc-bd88-675f24bc3363 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:20 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:20 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:20 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 1073741824 Jul 11 18:07:20 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:20 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684 Jul 11 18:07:20 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-29407758-4f9d-4b98-b0ba-ef8d01d9ec8b tempest-VolumeDependencyTests-1876859488 None] Create snapshot completed successfully Jul 11 18:07:20 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8b65987f-b37c-4464-9297-991033ab1684" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-quobyte-8b65987f-b37c-4464-9297-991033ab1684" released by "delete_volume" :: held 1.534s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Created reservations ['0cca91b2-588e-4aa3-af23-f9149229106a', '39cc5a3a-9a20-4376-93a3-0cd655746f7c', '40d594e7-109f-46ea-817b-0b9a9e912cc5', '2473b633-1268-4b92-af55-28979f8d7f8d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:20 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:20 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:20 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 1073741824" returned: 0 in 0.917s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:21 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 Jul 11 18:07:21 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Flow 'volume_create_manager' (660fa3cc-d0f0-49da-a8c6-0e68eafb4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8dc6fa-f358-4ff8-a8da-b50d31874116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8dc6fa-f358-4ff8-a8da-b50d31874116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-592222915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d8ce31-98f7-4fc7-a797-81800de4e443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100203253b6641fcb55fb45775012435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=482a39a5-a850-4888-8565-8c0d39c9c182,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:21Z,use_quota=True,user_id='7b34c854757547c1b1ca3aaf4e87a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42757ccf-9c6e-4995-aeba-9156c39c31fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42757ccf-9c6e-4995-aeba-9156c39c31fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b058b8-81ff-4586-9bb9-7f2a3241e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b058b8-81ff-4586-9bb9-7f2a3241e431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20d8ce31-98f7-4fc7-a797-81800de4e443', 'volume_name': 'volume-20d8ce31-98f7-4fc7-a797-81800de4e443', 'volume_size': 1, 'snapshot_id': '482a39a5-a850-4888-8565-8c0d39c9c182'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a610028-126d-44a7-b1c7-531dbe12b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a610028-126d-44a7-b1c7-531dbe12b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7676d47-a0ba-4056-a3a4-ac73ded72fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Volume 20d8ce31-98f7-4fc7-a797-81800de4e443: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20d8ce31-98f7-4fc7-a797-81800de4e443', 'volume_size': 1, 'snapshot_id': '482a39a5-a850-4888-8565-8c0d39c9c182'} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:21 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Deleted volume successfully. Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7e63ab1f-e6a3-4e1d-b303-b3f6fd79f7dd tempest-VolumesListAdminTestJSON-36987397 None] Lock "cinder-8b65987f-b37c-4464-9297-991033ab1684-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:21 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" returned: 0 in 0.694s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.490s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182-20d8ce31-98f7-4fc7-a797-81800de4e443" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182-20d8ce31-98f7-4fc7-a797-81800de4e443" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Creating volume 20d8ce31-98f7-4fc7-a797-81800de4e443 from snapshot 482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dbfa74-2d22-4ced-b744-e8722d5451e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0940d208-65af-4296-bb06-3166b0acfcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:21 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Volume volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 (3f7f4a4b-db3b-45bc-bd88-675f24bc3363): created successfully Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0940d208-65af-4296-bb06-3166b0acfcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Flow 'volume_create_manager' (f710b9a7-6fab-4533-9f9a-97ebe5ff118a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] snapshot: 482a39a5-a850-4888-8565-8c0d39c9c182, volume: 20d8ce31-98f7-4fc7-a797-81800de4e443, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:07:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-aeec814b-c5d2-41dd-8821-34f2bb0766c9 tempest-VolumesListTestJSON-373088715 None] Created volume successfully. Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6ff8e-9a88-4338-bc17-b3341131048b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:21 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:21 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:22 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.801s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93593ede-5049-4291-844f-8a8c39840582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a0753-1476-40b0-ba64-84a6b70abd84]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:22 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:22 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:23 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.980s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:23 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:07:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:23 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 Jul 11 18:07:23 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-3f7f4a4b-db3b-45bc-bd88-675f24bc3363-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-3f7f4a4b-db3b-45bc-bd88-675f24bc3363-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-quobyte-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e7c19-487d-4771-abae-ec87b0d02617]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:26 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 Jul 11 18:07:26 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:27 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" returned: 0 in 1.465s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:27 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363 Jul 11 18:07:27 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:28 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" returned: 0 in 1.345s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-3f7f4a4b-db3b-45bc-bd88-675f24bc3363" released by "delete_volume" :: held 2.918s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:28 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=153,cinder:SELECT=112,cinder:INSERT=38,cinder:DELETE=12 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:07:28 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=122,cinder:UPDATE=149,cinder:DELETE=14,cinder:INSERT=40 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:07:28 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Created reservations ['d0533f6f-87ef-42c5-b648-b9eda3735a81', '55c43aa9-fc2e-454d-a5df-23355b946641', '4c788d3d-488b-40ef-a93b-f8c35c93708b', '90063a97-de23-463a-aace-0b68726b92b5'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:29 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:29 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:29 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443" returned: 0 in 5.703s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9da748-f582-4354-96a2-7c2a78071ade]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:29 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:29 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-0f6ce26f-2542-45b0-a190-981b40661e0e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "cinder-0f6ce26f-2542-45b0-a190-981b40661e0e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-quobyte-0f6ce26f-2542-45b0-a190-981b40661e0e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-0f6ce26f-2542-45b0-a190-981b40661e0e" acquired by "delete_volume" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9eae3-c844-4cfa-b2ab-be1ba873fe98]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:29 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e Jul 11 18:07:29 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:29 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.753s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:29 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Deleted volume successfully. Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-43fc8157-b5fe-479a-b0f1-b5088ec22977 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-3f7f4a4b-db3b-45bc-bd88-675f24bc3363-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:30 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 1.115s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:07:30 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Converted 1024.00 MB image at 179.49 MB/s Jul 11 18:07:30 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 is being set with open permissions: ugo+rw Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:30 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 Jul 11 18:07:30 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:30 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:30 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e Jul 11 18:07:30 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:31 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443" returned: 0 in 0.666s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" released by "_copy_volume_from_snapshot" :: held 9.381s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182-20d8ce31-98f7-4fc7-a797-81800de4e443" released by "_create_volume_from_snapshot" :: held 9.446s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.466s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7676d47-a0ba-4056-a3a4-ac73ded72fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d8ce31-98f7-4fc7-a797-81800de4e443', 'volume_size': 1, 'snapshot_id': '482a39a5-a850-4888-8565-8c0d39c9c182'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e292b2-7533-47c4-b877-4d3c4432fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Volume volume-20d8ce31-98f7-4fc7-a797-81800de4e443 (20d8ce31-98f7-4fc7-a797-81800de4e443): created successfully Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e292b2-7533-47c4-b877-4d3c4432fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Flow 'volume_create_manager' (660fa3cc-d0f0-49da-a8c6-0e68eafb4edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-18cd3430-c849-40a3-bbd3-f8782a7f9ac9 tempest-VolumeDependencyTests-1876859488 None] Created volume successfully. Jul 11 18:07:31 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0f6ce26f-2542-45b0-a190-981b40661e0e" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-0f6ce26f-2542-45b0-a190-981b40661e0e" released by "delete_volume" :: held 1.657s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Created reservations ['2039e954-69ce-4b9e-b37d-3d910b4094be', 'e2e78941-b528-4dae-8453-afbb0ee0d19f', 'e1d578db-ae61-4d4a-845c-658471fd7b08', '870621c5-abf3-417e-8c9c-b643496db8ca'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:31 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:31 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Flow 'volume_create_manager' (9b92c894-84e5-4600-9ef7-86ce066563e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a4e2c-33ee-4577-8f0a-4e0823021fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a4e2c-33ee-4577-8f0a-4e0823021fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-751012663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf53e3f-b640-4cc5-aa84-27b87d3056c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef35d26ddc354d38a05253bb5dc67a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:31Z,use_quota=True,user_id='cdeea2e8ec184efe8e9a7579c9b0ad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3ef40d-8d8d-4e10-a93e-5bdc9a32b725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3ef40d-8d8d-4e10-a93e-5bdc9a32b725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111ef27c-4817-4350-bd5b-bb4c68e1e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111ef27c-4817-4350-bd5b-bb4c68e1e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf53e3f-b640-4cc5-aa84-27b87d3056c1', 'volume_name': 'volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935b406-1d7f-440d-abe2-9b03560cf559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935b406-1d7f-440d-abe2-9b03560cf559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3548897d-566f-4881-8888-62f231796ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:31 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Volume fdf53e3f-b640-4cc5-aa84-27b87d3056c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1', 'volume_size': 1} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-751012663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf53e3f-b640-4cc5-aa84-27b87d3056c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef35d26ddc354d38a05253bb5dc67a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:31Z,use_quota=True,user_id='cdeea2e8ec184efe8e9a7579c9b0ad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Creating volume fdf53e3f-b640-4cc5-aa84-27b87d3056c1 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:31 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:31 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 1073741824 Jul 11 18:07:31 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-37e3ac26-351e-4351-b0c1-b9cde3e39425-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-37e3ac26-351e-4351-b0c1-b9cde3e39425-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "cinder-quobyte-37e3ac26-351e-4351-b0c1-b9cde3e39425" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-37e3ac26-351e-4351-b0c1-b9cde3e39425" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8950379-d7cf-4b5c-bee3-c5057a6378b0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:32 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.662s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Deleted volume successfully. Jul 11 18:07:32 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 Jul 11 18:07:32 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-129d4e9c-7f48-4bfa-9dc5-2322e73fd21f tempest-VolumesListTestJSON-373088715 None] Lock "cinder-0f6ce26f-2542-45b0-a190-981b40661e0e-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-482a39a5-a850-4888-8565-8c0d39c9c182-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-482a39a5-a850-4888-8565-8c0d39c9c182-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:32 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 1073741824" returned: 0 in 0.861s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Deleting offline snapshot 482a39a5-a850-4888-8565-8c0d39c9c182 of volume 93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] snapshot_file for this snap is: volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[492344a6-9e9e-400f-901b-66a993cbb084]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:32 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 Jul 11 18:07:32 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:32 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:32 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:32 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425" returned: 0 in 0.818s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:32 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425 Jul 11 18:07:32 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:33 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" returned: 0 in 0.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3548897d-566f-4881-8888-62f231796ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d06231-cf3d-4de0-bd9b-7e0bb12ca520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Volume volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 (fdf53e3f-b640-4cc5-aa84-27b87d3056c1): created successfully Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d06231-cf3d-4de0-bd9b-7e0bb12ca520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Flow 'volume_create_manager' (9b92c894-84e5-4600-9ef7-86ce066563e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5c33c324-cf47-4b8e-89f6-323b91db7c35 tempest-VolumesMetadataTest-473230267 None] Created volume successfully. Jul 11 18:07:33 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93593ede-5049-4291-844f-8a8c39840582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c697f322-f271-47fa-83be-2e507bdbadc1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:33 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:33 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:33 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-37e3ac26-351e-4351-b0c1-b9cde3e39425" returned: 0 in 0.708s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-quobyte-37e3ac26-351e-4351-b0c1-b9cde3e39425" released by "delete_volume" :: held 1.586s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Created reservations ['4531fbbe-b314-4a7a-ac40-c9cad5196feb', '742fa733-4676-49f9-bd05-8d016ad48c24', 'c6b811bb-3e79-416a-bb56-cd59c422f0d1', '1bf03ff5-5f28-4069-9850-dc0e7271bae4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:33 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:33 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:34 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:34 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:34 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:34 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:34 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Acquiring lock "cinder-fdf53e3f-b640-4cc5-aa84-27b87d3056c1-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "cinder-fdf53e3f-b640-4cc5-aa84-27b87d3056c1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Acquiring lock "cinder-quobyte-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "cinder-quobyte-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:34 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ca152-3648-44f5-a6be-42d9abbbf179]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Deleted volume successfully. Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ab358d31-daaf-49e1-846c-66293294eff8 tempest-VolumesListTestJSON-373088715 None] Lock "cinder-37e3ac26-351e-4351-b0c1-b9cde3e39425-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:34 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 Jul 11 18:07:34 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:35 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.947s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:35 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.998s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:07:35 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182 Jul 11 18:07:35 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:35 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" returned: 0 in 0.906s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:35 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1 Jul 11 18:07:35 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:35 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582.482a39a5-a850-4888-8565-8c0d39c9c182" returned: 0 in 0.773s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-482a39a5-a850-4888-8565-8c0d39c9c182" released by "_delete_snapshot" :: held 3.465s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" released by "delete_snapshot" :: held 3.496s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Created reservations ['f47989a6-9477-4306-9aac-3f882036c76f', '0adc8323-6ab3-4565-a355-762f7b32b47f', '591539c4-0454-4bab-a96f-fd5d4b173874', 'c4138f64-cfb6-4f0d-83aa-3c2421a4b32d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Delete snapshot completed successfully. Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5831215c-c47a-45a7-b320-8d2b45692d06 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-482a39a5-a850-4888-8565-8c0d39c9c182-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:36 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" returned: 0 in 0.753s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "cinder-quobyte-fdf53e3f-b640-4cc5-aa84-27b87d3056c1" released by "delete_volume" :: held 1.738s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Created reservations ['bc3e371c-acab-4de8-bb7d-42a9337fb9b2', 'af0999fb-53e6-441f-9f6b-873a255c9d25', 'a0dabaeb-019b-4038-ba6f-a4c4371cf136', '98242b9c-a827-4e58-8533-ebb8681550d5'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:36 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:36 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-93593ede-5049-4291-844f-8a8c39840582-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-93593ede-5049-4291-844f-8a8c39840582-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f94e9-26ff-4497-8d44-edaad616424f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:36 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:36 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:37 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:37 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Deleted volume successfully. Jul 11 18:07:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-a70f1eea-9451-4ceb-a0a7-29f2d3a0b100 tempest-VolumesMetadataTest-473230267 None] Lock "cinder-fdf53e3f-b640-4cc5-aa84-27b87d3056c1-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:37 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.893s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:37 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582 Jul 11 18:07:37 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Flow 'volume_create_manager' (b5ca2cdc-f241-4bd8-b860-b395f9dfe2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3326a097-e80f-4fe4-b67c-f15394520aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3326a097-e80f-4fe4-b67c-f15394520aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-959577111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3304da-70ce-442f-9b03-93ff7a64f8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a36445fc83f44619b8ad6defd1479e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:38Z,use_quota=True,user_id='ca3fcc3570924af3aae8ddd8ead3df45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89f2ef-312b-414d-8059-b3d7a808418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89f2ef-312b-414d-8059-b3d7a808418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acee6dca-2c25-4f68-b1c2-9c8e82f7657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acee6dca-2c25-4f68-b1c2-9c8e82f7657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3304da-70ce-442f-9b03-93ff7a64f8b4', 'volume_name': 'volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4', 'volume_size': 2}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dbaa6f-e3cf-42d6-8874-59fc8bddcfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dbaa6f-e3cf-42d6-8874-59fc8bddcfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8ee12-2aea-4412-b36e-f79ed59ff855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:38 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Volume 9a3304da-70ce-442f-9b03-93ff7a64f8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4', 'volume_size': 2} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-959577111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3304da-70ce-442f-9b03-93ff7a64f8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a36445fc83f44619b8ad6defd1479e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:38Z,use_quota=True,user_id='ca3fcc3570924af3aae8ddd8ead3df45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Creating volume 9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:38 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 2147483648 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:38 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 2147483648 Jul 11 18:07:38 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:38 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-93593ede-5049-4291-844f-8a8c39840582" returned: 0 in 0.802s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-93593ede-5049-4291-844f-8a8c39840582" released by "delete_volume" :: held 1.770s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Created reservations ['54daf2e4-2761-479e-9b54-c73982add007', '537c61c7-d86a-402e-976a-a6bb7f6965ba', 'fc5ee8b6-ec2d-4e34-8070-51db8b57ba5b', '92db878d-a334-4b52-8839-9282b25389c7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:38 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:38 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-20d8ce31-98f7-4fc7-a797-81800de4e443-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:39 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 2147483648" returned: 0 in 1.032s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-20d8ce31-98f7-4fc7-a797-81800de4e443-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:39 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:39 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[429600d3-38f3-4ee6-b7c7-245638bdf14c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:39 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 Jul 11 18:07:39 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:39 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.729s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Deleted volume successfully. Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b36c52d6-6fc7-4e9b-9231-e984611f270e tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-93593ede-5049-4291-844f-8a8c39840582-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:39 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4" returned: 0 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8ee12-2aea-4412-b36e-f79ed59ff855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4', 'volume_size': 2}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c4d278-54dc-4d99-8e86-a2d42d66bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:40 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Volume volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 (9a3304da-70ce-442f-9b03-93ff7a64f8b4): created successfully Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c4d278-54dc-4d99-8e86-a2d42d66bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Flow 'volume_create_manager' (b5ca2cdc-f241-4bd8-b860-b395f9dfe2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c4a947e1-a268-4be5-8179-a212b7b3a2ab tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Created volume successfully. Jul 11 18:07:40 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:40 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443 Jul 11 18:07:40 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:40 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-20d8ce31-98f7-4fc7-a797-81800de4e443" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-quobyte-20d8ce31-98f7-4fc7-a797-81800de4e443" released by "delete_volume" :: held 1.542s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Created reservations ['9232c899-2f10-456c-b1b5-33ae506987d4', '21b65410-8587-4b97-9b47-6e71d1d6fb62', '6aff4170-8c5e-440e-8b8f-b1612e4da595', '408da734-c2a1-454d-ba3b-d8662b26fe00'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:40 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:40 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Flow 'volume_create_manager' (bfcbe53b-094f-48a6-9092-a008b2a9a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d8273-c1cf-4712-bf36-bac7f9b11913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d8273-c1cf-4712-bf36-bac7f9b11913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-436062262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9930a30-aa04-4bce-87e4-873f698c95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e49d3d76274b0fb3ff692c87332480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:41Z,use_quota=True,user_id='80e7fa681fd749ba9ac6d3c421524233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c519baa5-3757-4cce-b4cf-26f5d5d2a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c519baa5-3757-4cce-b4cf-26f5d5d2a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21ee77a-9b7e-4a40-9c43-5b3259e44e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21ee77a-9b7e-4a40-9c43-5b3259e44e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9930a30-aa04-4bce-87e4-873f698c95dc', 'volume_name': 'volume-e9930a30-aa04-4bce-87e4-873f698c95dc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3a7067-d5de-4928-9319-dc2b12587d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3a7067-d5de-4928-9319-dc2b12587d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cca7b0-ec1d-4f3e-a92c-72060b807c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Volume e9930a30-aa04-4bce-87e4-873f698c95dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9930a30-aa04-4bce-87e4-873f698c95dc', 'volume_size': 1} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Creating offline snapshot 84a50d35-6fdc-43b4-aece-69ea7d305a1d of volume 9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2848c4-028d-4eaf-950b-884ac7c1d379]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:41 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 Jul 11 18:07:41 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:41 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.810s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Deleted volume successfully. Jul 11 18:07:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e28b3eb2-4e5a-43e1-945b-f158cd36d9d2 tempest-VolumeDependencyTests-1876859488 None] Lock "cinder-20d8ce31-98f7-4fc7-a797-81800de4e443-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:42 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d 2G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:42 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d 2G Jul 11 18:07:42 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:43 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d 2G" returned: 0 in 0.877s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:43 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d Jul 11 18:07:43 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:43 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d" returned: 0 in 0.712s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:43 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d is being set with open permissions: ugo+rw Jul 11 18:07:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:44 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d Jul 11 18:07:44 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:44 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d" returned: 0 in 0.651s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:44 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info Jul 11 18:07:44 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:45 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info" returned: 0 in 0.648s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:45 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info is being set with open permissions: ugo+rw Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:45 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info Jul 11 18:07:45 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:45 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.info" returned: 0 in 0.627s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.459s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-436062262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9930a30-aa04-4bce-87e4-873f698c95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e49d3d76274b0fb3ff692c87332480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:41Z,use_quota=True,user_id='80e7fa681fd749ba9ac6d3c421524233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Creating volume e9930a30-aa04-4bce-87e4-873f698c95dc {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:45 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:46 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc 1073741824 Jul 11 18:07:46 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-998d26cd-4f1f-4cce-a4e5-2d80245586bd tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Create snapshot completed successfully Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Flow 'volume_create_manager' (ef3d8b8a-be04-4acc-99d0-9c9ad781da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90acff3f-69db-4ea1-a68e-6c7f2c6c6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "cinder-84a50d35-6fdc-43b4-aece-69ea7d305a1d-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90acff3f-69db-4ea1-a68e-6c7f2c6c6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56355ce9-4a04-4b36-abb3-2dfcf3bfd098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18e14567a1d4a438ccb9eb366a8a56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:47Z,use_quota=True,user_id='75647185e5d747fa9171807496ef96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d806a79-2dab-4474-8b1d-65ef8969d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d806a79-2dab-4474-8b1d-65ef8969d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc0edd1-8c78-4e01-a1b8-5df95256d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-84a50d35-6fdc-43b4-aece-69ea7d305a1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "cinder-quobyte-84a50d35-6fdc-43b4-aece-69ea7d305a1d" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-84a50d35-6fdc-43b4-aece-69ea7d305a1d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Deleting offline snapshot 84a50d35-6fdc-43b4-aece-69ea7d305a1d of volume 9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] snapshot_file for this snap is: volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49788ec9-0066-4f55-85c9-c681d1c6d2ab]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:46 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc 1073741824" returned: 0 in 0.943s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:46 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc Jul 11 18:07:46 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:47 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d Jul 11 18:07:47 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc0edd1-8c78-4e01-a1b8-5df95256d912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56355ce9-4a04-4b36-abb3-2dfcf3bfd098', 'volume_name': 'volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098', 'volume_size': 1, 'image_id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e635187f8cbaa8a3ab402e71f7caa3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18e14567a1d4a438ccb9eb366a8a56a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2eb5bbcbb99b67c946023ed288c4c993f92038bd7a53f20493df2b59de953e59e79f90a3586d06bd5756bcb4e18cda10ec413eeff4fd4bb3b74ca32bacf8148', 'id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'created_at': datetime.datetime(2026, 7, 11, 16, 7, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 7, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4e7bf8-818b-4018-a3e6-18071a188ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4e7bf8-818b-4018-a3e6-18071a188ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92588c3-fc81-450e-9af3-9e37006d52e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:47 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098', 'volume_size': 1, 'image_id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e635187f8cbaa8a3ab402e71f7caa3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18e14567a1d4a438ccb9eb366a8a56a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2eb5bbcbb99b67c946023ed288c4c993f92038bd7a53f20493df2b59de953e59e79f90a3586d06bd5756bcb4e18cda10ec413eeff4fd4bb3b74ca32bacf8148', 'id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'created_at': datetime.datetime(2026, 7, 11, 16, 7, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 7, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0/file', 'properties': {}}, 'image_service': } Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Trying to clone 56355ce9-4a04-4b36-abb3-2dfcf3bfd098 from image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:07:47 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1cf9a-3bee-4971-9a60-ded829aa8a76]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:47 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:47 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:47 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:47 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d" returned: 0 in 0.798s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc" returned: 0 in 0.765s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ba3db-2901-4f1c-9535-b1e186ff1479]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cca7b0-ec1d-4f3e-a92c-72060b807c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9930a30-aa04-4bce-87e4-873f698c95dc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9f5b1d-44e2-496a-98fa-08ca0a476f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:47 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Volume volume-e9930a30-aa04-4bce-87e4-873f698c95dc (e9930a30-aa04-4bce-87e4-873f698c95dc): created successfully Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9f5b1d-44e2-496a-98fa-08ca0a476f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Flow 'volume_create_manager' (bfcbe53b-094f-48a6-9092-a008b2a9a996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4ab26fae-ea07-414d-afa2-b067db3a9392 tempest-VolumesTransfersTest-942490201 None] Created volume successfully. Jul 11 18:07:47 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 Jul 11 18:07:47 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:47 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:48 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:48 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:48 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4" returned: 0 in 0.763s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:48 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d Jul 11 18:07:48 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:48 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 1 in 0.719s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Temporary image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 is fetched for user 75647185e5d747fa9171807496ef96bf. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf2d03b-92fe-4b68-b900-68ceb4fa9282]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:48 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:48 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:49 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d" returned: 0 in 0.759s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:49 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d Jul 11 18:07:49 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:49 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-451057dc-52a0-42a9-ad4f-2a5cc15e6280 tempest-VolumesTransfersTest-1990330381 None] Transfer volume completed successfully. Jul 11 18:07:49 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:49 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:49 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:49 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4.84a50d35-6fdc-43b4-aece-69ea7d305a1d" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-84a50d35-6fdc-43b4-aece-69ea7d305a1d" released by "_delete_snapshot" :: held 3.141s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" released by "delete_snapshot" :: held 3.168s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Created reservations ['7ea9549e-c9b2-4917-b2d8-665db791aaed', '478078c8-1f79-468b-9802-52fe5ea27bd7', 'cdd9d4ab-7317-4681-ae03-fd2ca9838fb0', '7a4a40b9-64d6-42bb-9ba7-d48efd735914'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Delete snapshot completed successfully. Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2901cb72-1d61-4b0d-85e0-b8e8067f5ab7 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-84a50d35-6fdc-43b4-aece-69ea7d305a1d-delete_snapshot" released by "delete_snapshot" :: held 3.333s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:50 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 1 in 0.736s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56355ce9-4a04-4b36-abb3-2dfcf3bfd098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18e14567a1d4a438ccb9eb366a8a56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:47Z,use_quota=True,user_id='75647185e5d747fa9171807496ef96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Creating volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:50 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:50 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1073741824 Jul 11 18:07:50 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "cinder-9a3304da-70ce-442f-9b03-93ff7a64f8b4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-9a3304da-70ce-442f-9b03-93ff7a64f8b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55e4ee8-4ff1-47f9-973c-e8daa0f956ea]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:51 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1073741824" returned: 0 in 0.879s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:51 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:07:51 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:51 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 Jul 11 18:07:51 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "cinder-e9930a30-aa04-4bce-87e4-873f698c95dc-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-e9930a30-aa04-4bce-87e4-873f698c95dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "cinder-quobyte-e9930a30-aa04-4bce-87e4-873f698c95dc" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-quobyte-e9930a30-aa04-4bce-87e4-873f698c95dc" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e7a7e-a8e6-40ca-bcd6-13fa18b74fcf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:51 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc Jul 11 18:07:51 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:51 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Attempting download of 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}])) to volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9137d57e-368c-45d2-b035-ab34735af009]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:51 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4" returned: 0 in 0.839s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:52 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4 Jul 11 18:07:52 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:52 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt Jul 11 18:07:52 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:52 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc" returned: 0 in 0.796s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:52 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc Jul 11 18:07:52 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:52 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9a3304da-70ce-442f-9b03-93ff7a64f8b4" returned: 0 in 0.686s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-quobyte-9a3304da-70ce-442f-9b03-93ff7a64f8b4" released by "delete_volume" :: held 1.599s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:52 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Created reservations ['1683849c-a686-49f5-bc3e-ed02b6219a32', '68910551-a212-4f08-b5c7-bff0035e143a', 'c08a03c9-ef7a-4ef5-acf2-a37ac1cb9461', '1c10bd06-ad93-49d2-9061-a50621deca1c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:52 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:52 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:52 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt Jul 11 18:07:52 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:53 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9930a30-aa04-4bce-87e4-873f698c95dc" returned: 0 in 0.693s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-quobyte-e9930a30-aa04-4bce-87e4-873f698c95dc" released by "delete_volume" :: held 1.531s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Created reservations ['e14ac92f-df50-40c5-8f91-b1f3bd96c0fe', 'c122bf33-ecc3-443d-ac79-4df9944e5627', '6a236009-fdb5-4bc2-9e66-0c80c0fde57e', 'ad20278b-f322-4a55-abf5-69e150dcb945'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:53 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:53 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:53 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt" returned: 1 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_d1_vz6wt' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a381b-71db-4f93-b80d-5563d9bee6fa]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:53 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.747s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Deleted volume successfully. Jul 11 18:07:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6da7d7e3-b3ae-45e4-8b78-97d671577e67 tempest-VolumesSnapshotNegativeTestJSON-1647067649 None] Lock "cinder-9a3304da-70ce-442f-9b03-93ff7a64f8b4-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:53 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:53 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:54 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Deleted volume successfully. Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-036f973f-1198-4ecc-baae-521508027d9a tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-e9930a30-aa04-4bce-87e4-873f698c95dc-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:54 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Flow 'volume_create_manager' (76a92c85-7da9-48f9-aa7f-34462d54ed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f402a7-2359-4a28-afc5-527dabe1442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f402a7-2359-4a28-afc5-527dabe1442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562431898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1e4917-60a4-4f4a-8779-85e6583ebe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e49d3d76274b0fb3ff692c87332480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:54Z,use_quota=True,user_id='80e7fa681fd749ba9ac6d3c421524233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40727807-1a82-42f7-ab8a-83a7d55a619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40727807-1a82-42f7-ab8a-83a7d55a619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:54 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD Jul 11 18:07:54 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a89db61-2741-40bf-b386-b474222eecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a89db61-2741-40bf-b386-b474222eecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1e4917-60a4-4f4a-8779-85e6583ebe02', 'volume_name': 'volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900235de-7a2f-48ff-8dc4-8bad24621b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900235de-7a2f-48ff-8dc4-8bad24621b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddb38a8-8a0a-4fd5-8b52-21377a4924ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:54 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Volume 9f1e4917-60a4-4f4a-8779-85e6583ebe02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02', 'volume_size': 1} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562431898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1e4917-60a4-4f4a-8779-85e6583ebe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e49d3d76274b0fb3ff692c87332480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:07:54Z,use_quota=True,user_id='80e7fa681fd749ba9ac6d3c421524233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Creating volume 9f1e4917-60a4-4f4a-8779-85e6583ebe02 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:07:54 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:07:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:54 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 1073741824 Jul 11 18:07:54 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:55 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD" returned: 1 in 0.792s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 was raw, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:55 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:07:55 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:55 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 1073741824" returned: 0 in 0.933s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:55 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 Jul 11 18:07:55 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:55 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ab06c7a-3874-4096-ba0b-3ed93cc220a0_vb8s_md4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:07:55 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:07:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:56 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1G Jul 11 18:07:56 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:56 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02" returned: 0 in 0.684s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddb38a8-8a0a-4fd5-8b52-21377a4924ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d1150-1d02-470b-92f7-3fe32ffafa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:56 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Volume volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 (9f1e4917-60a4-4f4a-8779-85e6583ebe02): created successfully Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d1150-1d02-470b-92f7-3fe32ffafa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Flow 'volume_create_manager' (76a92c85-7da9-48f9-aa7f-34462d54ed96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b8c38bac-e821-4aa3-9c97-ac6cc36cd945 tempest-VolumesTransfersTest-942490201 None] Created volume successfully. Jul 11 18:07:56 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 1G" returned: 0 in 0.761s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600447c-21a3-4ef0-a374-3d486005bc9b]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "cinder-9f1e4917-60a4-4f4a-8779-85e6583ebe02-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-9f1e4917-60a4-4f4a-8779-85e6583ebe02-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:56 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:07:56 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "cinder-quobyte-9f1e4917-60a4-4f4a-8779-85e6583ebe02" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-quobyte-9f1e4917-60a4-4f4a-8779-85e6583ebe02" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de729c1-c6fe-4173-8ff3-4dea7d1ed124]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:57 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 Jul 11 18:07:57 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:57 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 0 in 0.799s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:57 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:07:57 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:57 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02" returned: 0 in 0.820s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:57 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02 Jul 11 18:07:57 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:58 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 1 in 0.803s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Downloaded image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}])) to volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Temporary image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 for user 75647185e5d747fa9171807496ef96bf is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Marking volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Copying metadata from image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 to 56355ce9-4a04-4b36-abb3-2dfcf3bfd098. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Creating volume glance metadata for volume 56355ce9-4a04-4b36-abb3-2dfcf3bfd098 backed by image 5ab06c7a-3874-4096-ba0b-3ed93cc220a0 with: {'image_id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1e635187f8cbaa8a3ab402e71f7caa3d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92588c3-fc81-450e-9af3-9e37006d52e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098', 'volume_size': 1, 'image_id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e635187f8cbaa8a3ab402e71f7caa3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18e14567a1d4a438ccb9eb366a8a56a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2eb5bbcbb99b67c946023ed288c4c993f92038bd7a53f20493df2b59de953e59e79f90a3586d06bd5756bcb4e18cda10ec413eeff4fd4bb3b74ca32bacf8148', 'id': '5ab06c7a-3874-4096-ba0b-3ed93cc220a0', 'created_at': datetime.datetime(2026, 7, 11, 16, 7, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 7, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ab06c7a-3874-4096-ba0b-3ed93cc220a0/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad9afb-46cc-440c-8886-2372d99a3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:07:58 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Volume volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 (56355ce9-4a04-4b36-abb3-2dfcf3bfd098): created successfully Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad9afb-46cc-440c-8886-2372d99a3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Flow 'volume_create_manager' (ef3d8b8a-be04-4acc-99d0-9c9ad781da44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:07:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-23086e4c-db59-44e4-88dd-85ce408ed8ce tempest-VolumeImageDependencyTests-1806221005 None] Created volume successfully. Jul 11 18:07:58 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9f1e4917-60a4-4f4a-8779-85e6583ebe02" returned: 0 in 0.708s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-quobyte-9f1e4917-60a4-4f4a-8779-85e6583ebe02" released by "delete_volume" :: held 1.591s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Created reservations ['477e9f2f-2eb0-4b53-8bb8-12193dbc1880', '1a54fca8-d374-4a8f-8ef6-80328ea4befa', 'df609200-410a-458e-96c3-1d9a07ea655c', '6675bb41-88a1-4bc5-992b-f716b5e9d738'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:07:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:58 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:07:58 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:07:59 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.695s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:07:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Deleted volume successfully. Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-81e3af63-1352-4514-8723-82640e483139 tempest-VolumesTransfersTest-1679081340 None] Lock "cinder-9f1e4917-60a4-4f4a-8779-85e6583ebe02-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Acquiring lock "cinder-56355ce9-4a04-4b36-abb3-2dfcf3bfd098-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "cinder-56355ce9-4a04-4b36-abb3-2dfcf3bfd098-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Acquiring lock "cinder-quobyte-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "cinder-quobyte-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9509e2a4-da5f-4aba-abb0-5764254ec048]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:07:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:07:59 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:07:59 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:00 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 0 in 0.944s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:00 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:08:00 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:01 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 1 in 0.906s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:01 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098 Jul 11 18:08:01 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:02 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" returned: 0 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "cinder-quobyte-56355ce9-4a04-4b36-abb3-2dfcf3bfd098" released by "delete_volume" :: held 2.694s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Created reservations ['7ace8183-cac7-4d37-b1aa-34caff16bc20', 'd74c1b69-5288-411b-927d-76b79e602950', '69c441c6-705e-430c-b6a6-0a744092e0a8', '44b2628d-3702-435a-818c-f0297947c243'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:02 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:08:02 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:03 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.830s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:03 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:08:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Deleted volume successfully. Jul 11 18:08:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7a3d0608-4d32-420d-8f15-8fc4ec90b179 tempest-VolumeImageDependencyTests-1806221005 None] Lock "cinder-56355ce9-4a04-4b36-abb3-2dfcf3bfd098-delete_volume" released by "delete_volume" :: held 3.796s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Flow 'volume_create_manager' (bab2c13d-b7ad-4493-b0fb-783a698dd2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6b77cc-6eb1-4a0a-950f-2ed7411fdef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6b77cc-6eb1-4a0a-950f-2ed7411fdef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1168568924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b240756-d9fe-4c71-bf46-4848272997d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bee317eea4416b86389278774abc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:09Z,use_quota=True,user_id='af1dcad951d048cfa345b2e835e6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8197fdc9-5af1-4d0d-99d8-984ebe3ec215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8197fdc9-5af1-4d0d-99d8-984ebe3ec215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7b2b4c-afcf-48ef-b34b-7cbd6ee6b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7b2b4c-afcf-48ef-b34b-7cbd6ee6b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b240756-d9fe-4c71-bf46-4848272997d8', 'volume_name': 'volume-3b240756-d9fe-4c71-bf46-4848272997d8', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b9d06e-523a-426d-aff3-dc640962e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b9d06e-523a-426d-aff3-dc640962e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9c362a-88e0-48ba-baf1-8e7fb4c621d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Volume 3b240756-d9fe-4c71-bf46-4848272997d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b240756-d9fe-4c71-bf46-4848272997d8', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:08:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Trying to clone 3b240756-d9fe-4c71-bf46-4848272997d8 from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:08:09 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:08:09 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:08:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9170b69f-ae0d-4e58-9d42-5e0af7b537d3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:09 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD Jul 11 18:08:09 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:10 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD" returned: 0 in 0.931s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:10 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 is fetched for user af1dcad951d048cfa345b2e835e6fe7e. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:08:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[48334b19-c05c-4865-8d46-e0f260f809a2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:10 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD Jul 11 18:08:10 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:11 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1168568924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b240756-d9fe-4c71-bf46-4848272997d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bee317eea4416b86389278774abc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:09Z,use_quota=True,user_id='af1dcad951d048cfa345b2e835e6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Creating volume 3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:08:11 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:08:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:11 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1073741824 Jul 11 18:08:11 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:12 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1073741824" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:12 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:12 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:13 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 0.710s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Attempting download of 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume 3b240756-d9fe-4c71-bf46-4848272997d8. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc4aab-69ce-4080-9ff3-151be3ea34d3]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:13 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5 Jul 11 18:08:13 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:13 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5" returned: 0 in 0.730s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:13 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5 Jul 11 18:08:13 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:14 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5" returned: 1 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_tkmmhsj5' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4d9a0-d7bc-49a2-86af-4ca406839128]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:14 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD Jul 11 18:08:14 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:15 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD" returned: 0 in 0.710s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:15 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 was qcow2, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:08:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:15 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:15 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:17 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 2.044s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:17 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_6f1dsix2devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:08:17 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Converted 112.00 MB image at 54.77 MB/s Jul 11 18:08:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:17 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1G Jul 11 18:08:17 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:18 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 1G" returned: 0 in 0.698s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095343e-3ec1-4f45-9b6d-06a3c46f2b00]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:18 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:18 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:18 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 0.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:18 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:18 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:19 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 1 in 0.779s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Downloaded image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume 3b240756-d9fe-4c71-bf46-4848272997d8 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 for user af1dcad951d048cfa345b2e835e6fe7e is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Marking volume 3b240756-d9fe-4c71-bf46-4848272997d8 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Copying metadata from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 to 3b240756-d9fe-4c71-bf46-4848272997d8. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Creating volume glance metadata for volume 3b240756-d9fe-4c71-bf46-4848272997d8 backed by image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9c362a-88e0-48ba-baf1-8e7fb4c621d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b240756-d9fe-4c71-bf46-4848272997d8', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d0aebe-3342-4b44-a91b-cc240d55629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Volume volume-3b240756-d9fe-4c71-bf46-4848272997d8 (3b240756-d9fe-4c71-bf46-4848272997d8): created successfully Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d0aebe-3342-4b44-a91b-cc240d55629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Flow 'volume_create_manager' (bab2c13d-b7ad-4493-b0fb-783a698dd2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4b34baa6-3b79-44fe-8ab1-4a5d512e8913 tempest-VolumesExtendTest-1526210511 None] Created volume successfully. Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (c5e386f3-bcff-44f4-a477-cb84a8f1a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3042c406-823c-4c7f-89ab-39014d8b6fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ccd55a-fd04-4b29-8157-a3fd264b2258]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3042c406-823c-4c7f-89ab-39014d8b6fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-496367994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcb0fe2-cac6-46ff-a147-5902389744c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:20Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8510291-9c33-4cf5-ae10-d06fb510e28b),volume_type_id=f8510291-9c33-4cf5-ae10-d06fb510e28b)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61d47d-db36-4b45-9c0a-2ced046fbcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61d47d-db36-4b45-9c0a-2ced046fbcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ee2784-57b8-41f8-b889-d414819b04c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ee2784-57b8-41f8-b889-d414819b04c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcb0fe2-cac6-46ff-a147-5902389744c6', 'volume_name': 'volume-8bcb0fe2-cac6-46ff-a147-5902389744c6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d9c147-33aa-4258-9cdb-80a67b1326dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d9c147-33aa-4258-9cdb-80a67b1326dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c37460-4b1a-4116-bfe2-6f7ba588ecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume 8bcb0fe2-cac6-46ff-a147-5902389744c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcb0fe2-cac6-46ff-a147-5902389744c6', 'volume_size': 1} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:20 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:20 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (a549d03f-4a8e-4962-8323-ea2853509afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dc60d3-560f-40fc-a68f-a1e653e32c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dc60d3-560f-40fc-a68f-a1e653e32c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-277067405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86ed2c-0f3a-450f-b19d-eafc697f53c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:21Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(527d6c7e-7062-4ffb-92b1-8407b4f2102d),volume_type_id=527d6c7e-7062-4ffb-92b1-8407b4f2102d)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724245d6-159e-4ab4-a602-20e0b4c06cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724245d6-159e-4ab4-a602-20e0b4c06cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2798c71-c782-49d4-ae4a-35fae3c87b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2798c71-c782-49d4-ae4a-35fae3c87b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d86ed2c-0f3a-450f-b19d-eafc697f53c4', 'volume_name': 'volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930a37a-cb68-4788-b96a-49cdd8a8c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930a37a-cb68-4788-b96a-49cdd8a8c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eeaffac-fcdc-4709-bc44-a9ae9c2a9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume 0d86ed2c-0f3a-450f-b19d-eafc697f53c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4', 'volume_size': 1} Jul 11 18:08:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (2523d43b-6655-4118-8a62-1ac7f56f9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:21 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa42fb-8728-495c-8929-e2a8299c3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 0.821s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa42fb-8728-495c-8929-e2a8299c3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1495604949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df4237-69b9-4dc3-890e-c951eb3641cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:21Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a55c06-aaca-4bd8-b03d-fb6cd782017b),volume_type_id=25a55c06-aaca-4bd8-b03d-fb6cd782017b)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96953fad-8ef1-4a8f-a618-9d60b656e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96953fad-8ef1-4a8f-a618-9d60b656e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d15ed5d-d164-4d7a-9d12-7881759a6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:08:21 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:21 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d15ed5d-d164-4d7a-9d12-7881759a6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0df4237-69b9-4dc3-890e-c951eb3641cf', 'volume_name': 'volume-c0df4237-69b9-4dc3-890e-c951eb3641cf', 'volume_size': 1, 'image_id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--158430732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75817d186a4e440c856a12c568c212fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'created_at': datetime.datetime(2026, 7, 11, 16, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 8, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e6b952-148e-4e4d-be6d-c4453f26d214/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365060ad-8f7b-41f0-a2c3-757b3baa3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365060ad-8f7b-41f0-a2c3-757b3baa3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513280c0-c594-4ad2-adea-e324a9a0e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:21 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume c0df4237-69b9-4dc3-890e-c951eb3641cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0df4237-69b9-4dc3-890e-c951eb3641cf', 'volume_size': 1, 'image_id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--158430732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75817d186a4e440c856a12c568c212fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'created_at': datetime.datetime(2026, 7, 11, 16, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 8, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e6b952-148e-4e4d-be6d-c4453f26d214/file', 'properties': {}}, 'image_service': } Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Trying to clone c0df4237-69b9-4dc3-890e-c951eb3641cf from image f8e6b952-148e-4e4d-be6d-c4453f26d214 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:08:21 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 1 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 2G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 2G" returned: 0 in 0.070s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.730s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-496367994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcb0fe2-cac6-46ff-a147-5902389744c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:20Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8510291-9c33-4cf5-ae10-d06fb510e28b),volume_type_id=f8510291-9c33-4cf5-ae10-d06fb510e28b)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Creating volume 8bcb0fe2-cac6-46ff-a147-5902389744c6 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:08:22 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:22 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 1073741824 Jul 11 18:08:22 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-df0c8f3b-6921-45b3-b05e-647460f3e663 tempest-VolumesExtendTest-1526210511 None] Extend volume completed successfully. Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-3b240756-d9fe-4c71-bf46-4848272997d8-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-3b240756-d9fe-4c71-bf46-4848272997d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-quobyte-3b240756-d9fe-4c71-bf46-4848272997d8" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-3b240756-d9fe-4c71-bf46-4848272997d8" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb44760-adc7-4d4a-96d8-306ff4bb216a]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:22 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:22 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:22 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 1073741824" returned: 0 in 0.875s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:22 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 Jul 11 18:08:22 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:23 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:23 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6" returned: 0 in 0.722s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-277067405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86ed2c-0f3a-450f-b19d-eafc697f53c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:21Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(527d6c7e-7062-4ffb-92b1-8407b4f2102d),volume_type_id=527d6c7e-7062-4ffb-92b1-8407b4f2102d)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Creating volume 0d86ed2c-0f3a-450f-b19d-eafc697f53c4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:08:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:23 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:23 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:23 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 1073741824 Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c37460-4b1a-4116-bfe2-6f7ba588ecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcb0fe2-cac6-46ff-a147-5902389744c6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:23 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbe97fd-499b-444e-9c05-5cc9b4cca1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 (8bcb0fe2-cac6-46ff-a147-5902389744c6): created successfully Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbe97fd-499b-444e-9c05-5cc9b4cca1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (c5e386f3-bcff-44f4-a477-cb84a8f1a19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-46da1c4c-9244-4a25-94e9-3ba6127e0386 tempest-TestInstancesWithCinderVolumes-1217518464 None] Created volume successfully. Jul 11 18:08:24 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 1 in 0.822s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:24 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8 Jul 11 18:08:24 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:24 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 1073741824" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:24 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 Jul 11 18:08:24 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD, size 20.69 MB, duration 3.39 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:08:24 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Image download 20.69 MB at 6.11 MB/s Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc92ce5-e34c-4ee4-b241-53732110e923]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:24 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD Jul 11 18:08:24 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:25 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3b240756-d9fe-4c71-bf46-4848272997d8" returned: 0 in 0.681s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-3b240756-d9fe-4c71-bf46-4848272997d8" released by "delete_volume" :: held 2.415s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Created reservations ['505e0929-d281-4c27-8998-dd1e520ab145', '0ab665c9-8c78-44e7-8954-051063a39d30', '14290232-959e-4fd4-8d81-ff08840da7ce', '24b1fd17-8a7c-45b4-a787-8c327e633c82'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:25 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" returned: 0 in 0.682s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:25 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:08:25 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eeaffac-fcdc-4709-bc44-a9ae9c2a9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6872bcb2-63cb-4a04-b586-e453feafdbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 (0d86ed2c-0f3a-450f-b19d-eafc697f53c4): created successfully Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6872bcb2-63cb-4a04-b586-e453feafdbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (a549d03f-4a8e-4962-8323-ea2853509afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8ebf34c3-791d-4068-b00c-a1d1c8c3d698 tempest-TestInstancesWithCinderVolumes-1217518464 None] Created volume successfully. Jul 11 18:08:25 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Temporary image f8e6b952-148e-4e4d-be6d-c4453f26d214 is fetched for user 8bab6195dca447afb1baf7e7ee4dabcf. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07438f1-57b6-444b-9687-6d9f2f4abf5d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:25 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD Jul 11 18:08:25 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:25 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:08:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Deleted volume successfully. Jul 11 18:08:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-15b3e665-7cf9-45f5-a066-24b07f865e82 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-3b240756-d9fe-4c71-bf46-4848272997d8-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Flow 'volume_create_manager' (f36ecde4-fc89-4693-9c69-d7171d1d9661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73035f91-bc0e-47fb-8ac7-dd0f401c6e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:26 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD" returned: 0 in 0.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1495604949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df4237-69b9-4dc3-890e-c951eb3641cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75817d186a4e440c856a12c568c212fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:21Z,use_quota=True,user_id='8bab6195dca447afb1baf7e7ee4dabcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a55c06-aaca-4bd8-b03d-fb6cd782017b),volume_type_id=25a55c06-aaca-4bd8-b03d-fb6cd782017b)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Creating volume c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:08:26 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73035f91-bc0e-47fb-8ac7-dd0f401c6e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846912223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d3c49f-b939-4b97-aacd-3ca08a14a34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bee317eea4416b86389278774abc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:26Z,use_quota=True,user_id='af1dcad951d048cfa345b2e835e6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b2b14d-375f-4bf6-922e-dfdf716e1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:26 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1073741824 Jul 11 18:08:26 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b2b14d-375f-4bf6-922e-dfdf716e1c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f77dd73-85b4-446f-a558-0f510a4047e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f77dd73-85b4-446f-a558-0f510a4047e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d3c49f-b939-4b97-aacd-3ca08a14a34c', 'volume_name': 'volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4cc844-1222-4529-9f9a-56a2d7cfb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4cc844-1222-4529-9f9a-56a2d7cfb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400fb804-338d-4efa-acfe-824002bda372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:26 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Volume e1d3c49f-b939-4b97-aacd-3ca08a14a34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c', 'volume_size': 1} Jul 11 18:08:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:27 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1073741824" returned: 0 in 0.822s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:27 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:27 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:27 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846912223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d3c49f-b939-4b97-aacd-3ca08a14a34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bee317eea4416b86389278774abc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:08:26Z,use_quota=True,user_id='af1dcad951d048cfa345b2e835e6fe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Creating volume e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:08:27 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:08:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:28 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c 1073741824 Jul 11 18:08:28 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Attempting download of f8e6b952-148e-4e4d-be6d-c4453f26d214 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}])) to volume c0df4237-69b9-4dc3-890e-c951eb3641cf. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe63285-ccba-4032-adbd-14d87d8a2f56]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:28 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x Jul 11 18:08:28 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:28 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c 1073741824" returned: 0 in 0.806s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:28 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x" returned: 0 in 0.749s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:28 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:28 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:28 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x Jul 11 18:08:28 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:29 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.626s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=134,cinder:SELECT=107,cinder:DELETE=11,cinder:INSERT=46 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400fb804-338d-4efa-acfe-824002bda372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b4d94a-f37d-41f3-b2e2-aa3c015d5302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=101,cinder:INSERT=40,cinder:UPDATE=138,cinder:DELETE=10 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:08:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Volume volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c (e1d3c49f-b939-4b97-aacd-3ca08a14a34c): created successfully Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b4d94a-f37d-41f3-b2e2-aa3c015d5302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Flow 'volume_create_manager' (f36ecde4-fc89-4693-9c69-d7171d1d9661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f89ab477-37de-4da6-b4b4-6af2160018f9 tempest-VolumesExtendTest-1526210511 None] Created volume successfully. Jul 11 18:08:29 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x" returned: 1 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e6b952-148e-4e4d-be6d-c4453f26d214__mv8ud2x' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fdbe38-940f-46fa-b4f8-958cda3c0305]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:29 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD Jul 11 18:08:29 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:30 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] f8e6b952-148e-4e4d-be6d-c4453f26d214 was qcow2, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:30 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:30 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Creating offline snapshot fd08659c-5ab1-422e-9b24-aadae567afef of volume e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c09428d-e6bc-40c0-9db6-6d8b97c9f8f8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:30 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:30 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:31 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.823s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:31 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef 1G Jul 11 18:08:31 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:32 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 1.786s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e6b952-148e-4e4d-be6d-c4453f26d214_0cgklg88devstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:08:32 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Converted 112.00 MB image at 62.65 MB/s Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:32 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1G Jul 11 18:08:32 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:32 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef 1G" returned: 0 in 0.839s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:32 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef Jul 11 18:08:32 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:32 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf 1G" returned: 0 in 0.694s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc0fb7-f8d0-4eee-a66c-e0ad47e1ed28]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:32 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:32 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:33 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef" returned: 0 in 0.682s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:33 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef is being set with open permissions: ugo+rw Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:33 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef Jul 11 18:08:33 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:33 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 0.735s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:33 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:33 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:33 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:33 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info Jul 11 18:08:33 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:34 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:08:34 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:34 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 1 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Downloaded image f8e6b952-148e-4e4d-be6d-c4453f26d214 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}])) to volume c0df4237-69b9-4dc3-890e-c951eb3641cf successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Temporary image f8e6b952-148e-4e4d-be6d-c4453f26d214 for user 8bab6195dca447afb1baf7e7ee4dabcf is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Marking volume c0df4237-69b9-4dc3-890e-c951eb3641cf as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Copying metadata from image f8e6b952-148e-4e4d-be6d-c4453f26d214 to c0df4237-69b9-4dc3-890e-c951eb3641cf. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Creating volume glance metadata for volume c0df4237-69b9-4dc3-890e-c951eb3641cf backed by image f8e6b952-148e-4e4d-be6d-c4453f26d214 with: {'image_id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'image_name': 'tempest-scenario-img--158430732', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513280c0-c594-4ad2-adea-e324a9a0e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0df4237-69b9-4dc3-890e-c951eb3641cf', 'volume_size': 1, 'image_id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e6b952-148e-4e4d-be6d-c4453f26d214', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--158430732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75817d186a4e440c856a12c568c212fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e6b952-148e-4e4d-be6d-c4453f26d214', 'created_at': datetime.datetime(2026, 7, 11, 16, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 8, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e6b952-148e-4e4d-be6d-c4453f26d214/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0f6786-fadd-4d54-9868-2ea1b54ee1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:08:34 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Volume volume-c0df4237-69b9-4dc3-890e-c951eb3641cf (c0df4237-69b9-4dc3-890e-c951eb3641cf): created successfully Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0f6786-fadd-4d54-9868-2ea1b54ee1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Flow 'volume_create_manager' (2523d43b-6655-4118-8a62-1ac7f56f9478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:08:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-36b44ea6-16a7-4157-a0a1-cadc84702e63 tempest-TestInstancesWithCinderVolumes-1217518464 None] Created volume successfully. Jul 11 18:08:34 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info" returned: 0 in 0.647s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:34 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info is being set with open permissions: ugo+rw Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:34 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info Jul 11 18:08:34 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:34 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.647s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:08:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:08:35 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.info" returned: 0 in 0.645s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6b55fffa-e205-4a71-8c75-81e7398af1a0 tempest-VolumesExtendTest-1526210511 None] Create snapshot completed successfully Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c2d02d-c0fa-46ca-b513-151794fe2345]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:36 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:36 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:36 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef 2G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef 2G" returned: 0 in 0.139s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.934s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d456c895-d256-4946-86b5-c34f99caeeee tempest-VolumesExtendTest-1526210511 None] Extend volume completed successfully. Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-fd08659c-5ab1-422e-9b24-aadae567afef-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-fd08659c-5ab1-422e-9b24-aadae567afef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-quobyte-fd08659c-5ab1-422e-9b24-aadae567afef" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-fd08659c-5ab1-422e-9b24-aadae567afef" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Deleting offline snapshot fd08659c-5ab1-422e-9b24-aadae567afef of volume e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] snapshot_file for this snap is: volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[58346351-c86b-4afd-9fb1-9b7b87c7ccff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:37 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef Jul 11 18:08:37 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:38 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef" returned: 0 in 0.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1746921d-0ab6-4c04-be1c-239a4306a2b6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:38 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:38 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:38 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:39 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef Jul 11 18:08:39 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:39 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef" returned: 0 in 0.774s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:39 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef Jul 11 18:08:39 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:40 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c.fd08659c-5ab1-422e-9b24-aadae567afef" returned: 0 in 0.648s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-fd08659c-5ab1-422e-9b24-aadae567afef" released by "_delete_snapshot" :: held 3.049s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" released by "delete_snapshot" :: held 3.071s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:40 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Created reservations ['7d25cf91-7157-46c8-a069-6c2944b01bf1', 'd532e6ad-3530-4294-b294-7d04a43acdd8', 'f0442320-bf22-4a75-b135-ab85a28772fb', 'e0fb6435-9c9c-4241-abd2-b3df7f98d166'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:08:40 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Delete snapshot completed successfully. Jul 11 18:08:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9e130978-f418-4e8b-a177-4955fce76b56 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-fd08659c-5ab1-422e-9b24-aadae567afef-delete_snapshot" released by "delete_snapshot" :: held 3.235s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-e1d3c49f-b939-4b97-aacd-3ca08a14a34c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-e1d3c49f-b939-4b97-aacd-3ca08a14a34c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[29413155-7667-4a92-bd70-6f6d37d66487]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:41 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:41 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b5e3b-0f01-4bcd-bcb3-8ddfcf7f34da]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:42 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:42 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:42 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.914s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:42 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c Jul 11 18:08:42 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:43 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:43 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:08:43 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:43 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" returned: 0 in 0.722s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-quobyte-e1d3c49f-b939-4b97-aacd-3ca08a14a34c" released by "delete_volume" :: held 1.725s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Created reservations ['72f7c19b-6065-49f2-8e0d-0633ab3d445c', 'a159706b-be92-4789-9fb2-52bde3e1071f', '064da2d5-3a5e-4212-985c-c253bc5e1c5e', 'f7eda48c-b41c-49d8-a82a-ca19503ffb14'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:08:43 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:08:43 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:08:43 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 1 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.707s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:08:43 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-c0df4237-69b9-4dc3-890e-c951eb3641cf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd64cca42-f900-4718-a1b3-c36459d4b74a', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:08:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1d14cf4d-46d6-46a6-9ce1-00666426fe3a req-381a6c4c-2859-4d62-bdcb-cd1a72ca3c71 tempest-TestInstancesWithCinderVolumes-1217518464 None] attachment_update completed successfully. Jul 11 18:08:44 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 11 18:08:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.712s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:08:44 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:08:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Deleted volume successfully. Jul 11 18:08:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd276a3c-d7ee-471b-a9ea-727880f6b083 tempest-VolumesExtendTest-1526210511 None] Lock "cinder-e1d3c49f-b939-4b97-aacd-3ca08a14a34c-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:08:53 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=21,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:08:54 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=23,cinder:DELETE=3,cinder:SELECT=23,cinder:INSERT=9 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Flow 'volume_create_manager' (e9429b04-8cfd-4b35-b283-b9af8e167b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28790030-ebb6-4e51-bd88-4e567ec5d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28790030-ebb6-4e51-bd88-4e567ec5d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1297187921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd342d780ca46bea9903c42e6cf9ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:09:08Z,use_quota=True,user_id='9bdf6bc494f345c2b18a97cd547a5e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3070614e-28fd-46d7-81e5-a80cd8d957fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3070614e-28fd-46d7-81e5-a80cd8d957fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae55f61c-f5f3-40ed-b44c-199f8a29d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae55f61c-f5f3-40ed-b44c-199f8a29d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51', 'volume_name': 'volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae62630-af66-4e9e-8fa9-4f1aa5a037aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae62630-af66-4e9e-8fa9-4f1aa5a037aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77aadb5-c83a-409d-bff9-81440ee996a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51', 'volume_size': 1} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1297187921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd342d780ca46bea9903c42e6cf9ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:09:08Z,use_quota=True,user_id='9bdf6bc494f345c2b18a97cd547a5e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Creating volume a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:09:07 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:09:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:07 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 1073741824 Jul 11 18:09:07 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Flow 'volume_create_manager' (7b9f7bbc-e50d-4aeb-a891-76f31f945a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16576754-a93d-4174-8f80-dc82887776d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16576754-a93d-4174-8f80-dc82887776d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-961134009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ddb237-ffb6-4116-91c2-81b5a6434a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd342d780ca46bea9903c42e6cf9ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:09:08Z,use_quota=True,user_id='9bdf6bc494f345c2b18a97cd547a5e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238489eb-2af1-4a73-9b58-503855f339f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238489eb-2af1-4a73-9b58-503855f339f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1838f025-f724-48d8-a080-b04dc5a6bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1838f025-f724-48d8-a080-b04dc5a6bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ddb237-ffb6-4116-91c2-81b5a6434a8e', 'volume_name': 'volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4402d7-8400-460b-a365-36e89c3aff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4402d7-8400-460b-a365-36e89c3aff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5077d0e9-856e-4062-b270-fbef53559f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume c2ddb237-ffb6-4116-91c2-81b5a6434a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e', 'volume_size': 1} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:08 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 1073741824" returned: 0 in 0.883s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:08 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 Jul 11 18:09:08 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:09 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" returned: 0 in 0.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-961134009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ddb237-ffb6-4116-91c2-81b5a6434a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd342d780ca46bea9903c42e6cf9ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:09:08Z,use_quota=True,user_id='9bdf6bc494f345c2b18a97cd547a5e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Creating volume c2ddb237-ffb6-4116-91c2-81b5a6434a8e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:09:09 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77aadb5-c83a-409d-bff9-81440ee996a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:09 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e 1073741824 Jul 11 18:09:09 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533934a7-93d3-489c-a5a6-06e332b9d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 (a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51): created successfully Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533934a7-93d3-489c-a5a6-06e332b9d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Flow 'volume_create_manager' (e9429b04-8cfd-4b35-b283-b9af8e167b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:09:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5b0df658-5db6-43cd-ba26-ec50570bfa91 tempest-TestServerVolumeAttachmentScenario-386423166 None] Created volume successfully. Jul 11 18:09:10 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e 1073741824" returned: 0 in 0.860s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:10 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e Jul 11 18:09:10 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:10 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" returned: 0 in 0.686s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5077d0e9-856e-4062-b270-fbef53559f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f1aae1-eeb9-4698-9a86-15328eb2fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:09:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Volume volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e (c2ddb237-ffb6-4116-91c2-81b5a6434a8e): created successfully Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f1aae1-eeb9-4698-9a86-15328eb2fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:09:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Flow 'volume_create_manager' (7b9f7bbc-e50d-4aeb-a891-76f31f945a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:09:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b3203ba3-22df-49e6-b70d-a93f2b38654d tempest-TestServerVolumeAttachmentScenario-386423166 None] Created volume successfully. Jul 11 18:09:20 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:09:20 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:09:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca677218-9169-4886-9f66-ae9706e8de63]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:22 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 Jul 11 18:09:22 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:23 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-8bcb0fe2-cac6-46ff-a147-5902389744c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12d6240b-3b68-4159-b035-19433c47d9bb', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:09:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-a5476e9b-74eb-43ce-ab60-3322fd5ad1f5 req-06c81964-9839-47be-a83e-d6d154779880 tempest-TestInstancesWithCinderVolumes-1217518464 None] attachment_update completed successfully. Jul 11 18:09:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:30 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eab4e8-3122-4337-8640-685173b80dfa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:30 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 Jul 11 18:09:30 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:31 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" returned: 0 in 0.792s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.815s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:31 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f4c7c5a-04bf-42d2-b696-c03b8a55bf5e', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:09:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-4dbda4cf-5eeb-4f73-9e55-a0ad6242c802 req-3be3b425-ab22-4aea-b58d-c4fce864b78e tempest-TestInstancesWithCinderVolumes-1217518464 None] attachment_update completed successfully. Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:34 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:09:34 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:34 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:09:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:09:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-5f89e12b-12f6-4ac0-aa14-0680a8cf0c09 req-1f238040-0ab5-4715-a0a6-ec2b3080d13f tempest-TestInstancesWithCinderVolumes-1217518464 None] Terminate volume connection completed successfully. Jul 11 18:09:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-5f89e12b-12f6-4ac0-aa14-0680a8cf0c09 req-1f238040-0ab5-4715-a0a6-ec2b3080d13f tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleting attachment 12d6240b-3b68-4159-b035-19433c47d9bb. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-8bcb0fe2-cac6-46ff-a147-5902389744c6-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-8bcb0fe2-cac6-46ff-a147-5902389744c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-quobyte-8bcb0fe2-cac6-46ff-a147-5902389744c6" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-8bcb0fe2-cac6-46ff-a147-5902389744c6" acquired by "delete_volume" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[21621923-0ce0-4cd2-aeaf-6cb82d90555e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:42 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 Jul 11 18:09:42 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:42 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:42 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6 Jul 11 18:09:42 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:43 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-8bcb0fe2-cac6-46ff-a147-5902389744c6" returned: 0 in 0.728s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-8bcb0fe2-cac6-46ff-a147-5902389744c6" released by "delete_volume" :: held 1.628s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:09:43 devstack cinder-volume[86932]: WARNING cinder.quota [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1926453996-350977864 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1926453996-350977864, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:09:43 devstack cinder-volume[86932]: WARNING cinder.quota [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1926453996-350977864 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1926453996-350977864, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Created reservations ['d0e35ff6-c2c7-4119-bd09-1b4d3f4dcafb', 'db07edb6-8cb6-439b-a53b-b861cf4cdd9f', '2e1dc6ff-59ee-4ecb-abca-4434823f46e8', '2485b1d5-1ae8-4ce6-9d78-85852df2413e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:43 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:09:43 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:44 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.731s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:44 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:09:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleted volume successfully. Jul 11 18:09:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5df7546e-f995-4df0-bc18-50959acdadb0 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-8bcb0fe2-cac6-46ff-a147-5902389744c6-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:09:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-f6dfdfbb-065c-4420-a23c-ca4f9b6888f4 req-be52ba86-d4a4-4783-9cb1-dcca479ab214 tempest-TestInstancesWithCinderVolumes-1217518464 None] Terminate volume connection completed successfully. Jul 11 18:09:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-f6dfdfbb-065c-4420-a23c-ca4f9b6888f4 req-be52ba86-d4a4-4783-9cb1-dcca479ab214 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleting attachment 2f4c7c5a-04bf-42d2-b696-c03b8a55bf5e. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-0d86ed2c-0f3a-450f-b19d-eafc697f53c4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-0d86ed2c-0f3a-450f-b19d-eafc697f53c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-quobyte-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[59346c23-66ab-453d-915c-4c0809fcc6a0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:48 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 Jul 11 18:09:48 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[80350292-cd88-491e-b9fd-57ddc3f3636e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:49 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 Jul 11 18:09:49 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:49 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" returned: 0 in 0.820s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:49 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4 Jul 11 18:09:49 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:49 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" returned: 0 in 0.911s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:49 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '350c66a7-b20d-4906-98ad-bf6ff07c6810', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:09:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-d29095e6-536f-4307-8912-6a2a6eef39db req-093de05a-52a5-4125-adbe-766a9b7921e2 tempest-TestServerVolumeAttachmentScenario-386423166 None] attachment_update completed successfully. Jul 11 18:09:50 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" returned: 0 in 0.761s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-0d86ed2c-0f3a-450f-b19d-eafc697f53c4" released by "delete_volume" :: held 1.636s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:09:50 devstack cinder-volume[86932]: WARNING cinder.quota [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872702431-1843131541 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872702431-1843131541, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:09:50 devstack cinder-volume[86932]: WARNING cinder.quota [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872702431-1843131541 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872702431-1843131541, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Created reservations ['cd7b0641-92f3-4f9b-aad0-411c3798c33f', 'a2c5b132-631d-49f7-bd1b-a2f6ee66397b', '606f3e2c-9c85-4af3-91f0-17543cb2f884', '102597fd-ff03-4dd8-a5a9-d806c45401db'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:50 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:09:50 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:51 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.785s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:51 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:09:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleted volume successfully. Jul 11 18:09:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-403db687-1293-4241-a4cc-41c7fb7da7f5 tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-0d86ed2c-0f3a-450f-b19d-eafc697f53c4-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:09:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-ef868a6b-e255-4a0f-ace5-9172c8283f43 req-ba972e17-bc89-418e-a14b-21196e67c13b tempest-TestInstancesWithCinderVolumes-1217518464 None] Terminate volume connection completed successfully. Jul 11 18:09:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-ef868a6b-e255-4a0f-ace5-9172c8283f43 req-ba972e17-bc89-418e-a14b-21196e67c13b tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleting attachment d64cca42-f900-4718-a1b3-c36459d4b74a. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-c0df4237-69b9-4dc3-890e-c951eb3641cf-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-c0df4237-69b9-4dc3-890e-c951eb3641cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "cinder-quobyte-c0df4237-69b9-4dc3-890e-c951eb3641cf" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-c0df4237-69b9-4dc3-890e-c951eb3641cf" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b28d55-364f-4429-9b41-6c00c7757e99]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:58 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:09:58 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0dc24-57ec-4370-b3a9-e5cedb03c212]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:09:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:58 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e Jul 11 18:09:58 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:59 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 0.786s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:59 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:09:59 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:09:59 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5ea6c5f-7742-4fed-b4ba-c953dfa4e7fa', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:09:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-27a51b05-7efc-44c7-a050-0b4a2db452ef req-4ca39e7d-da52-4b79-b0e3-7e31d483a407 tempest-TestServerVolumeAttachmentScenario-386423166 None] attachment_update completed successfully. Jul 11 18:09:59 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 1 in 0.748s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:09:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:09:59 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf Jul 11 18:09:59 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:00 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c0df4237-69b9-4dc3-890e-c951eb3641cf" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-quobyte-c0df4237-69b9-4dc3-890e-c951eb3641cf" released by "delete_volume" :: held 2.293s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:00 devstack cinder-volume[86932]: WARNING cinder.quota [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-261323114-1034243586 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-261323114-1034243586, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:10:00 devstack cinder-volume[86932]: WARNING cinder.quota [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-261323114-1034243586 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-261323114-1034243586, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Created reservations ['ab633009-0229-4650-bb89-7355e7347fd1', 'a6a6bdcd-683d-4d44-be83-94520d38fd73', 'e68c434d-6cc9-4c99-8356-763413c78410', '34ec9e95-c50e-40d5-804a-fb042fbb8fa3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:00 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:10:00 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:01 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.625s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:10:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Deleted volume successfully. Jul 11 18:10:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c0eccfe1-57e2-4ff8-9f32-7b507c2096cf tempest-TestInstancesWithCinderVolumes-1217518464 None] Lock "cinder-c0df4237-69b9-4dc3-890e-c951eb3641cf-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-8db60bc9-f0f1-468f-a6d8-443babe5617f req-55300780-fcc4-44cc-9319-99ef768d9f93 tempest-TestServerVolumeAttachmentScenario-386423166 None] Terminate volume connection completed successfully. Jul 11 18:10:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-8db60bc9-f0f1-468f-a6d8-443babe5617f req-55300780-fcc4-44cc-9319-99ef768d9f93 tempest-TestServerVolumeAttachmentScenario-386423166 None] Deleting attachment e5ea6c5f-7742-4fed-b4ba-c953dfa4e7fa. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:10:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-89f8defd-512b-4109-a5c5-a01b9d087adc req-3a8f19e6-be82-4719-b797-ed59fb7a80b3 tempest-TestServerVolumeAttachmentScenario-386423166 None] Terminate volume connection completed successfully. Jul 11 18:10:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-89f8defd-512b-4109-a5c5-a01b9d087adc req-3a8f19e6-be82-4719-b797-ed59fb7a80b3 tempest-TestServerVolumeAttachmentScenario-386423166 None] Deleting attachment 350c66a7-b20d-4906-98ad-bf6ff07c6810. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:10:15 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=40,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=44,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "cinder-c2ddb237-ffb6-4116-91c2-81b5a6434a8e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-c2ddb237-ffb6-4116-91c2-81b5a6434a8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "cinder-quobyte-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-quobyte-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f7a3f1-7eb2-41d8-b01e-7c2298213c5a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:10:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:19 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e Jul 11 18:10:19 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:20 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" returned: 0 in 0.929s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:20 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e Jul 11 18:10:20 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:21 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-quobyte-c2ddb237-ffb6-4116-91c2-81b5a6434a8e" released by "delete_volume" :: held 1.686s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Created reservations ['6943f480-a932-4a98-8c22-1768df9aeff4', '3f5de755-290c-4e46-998e-814ddeda5a6e', 'd4845394-1a18-4c6d-8d82-68067ce309a8', '77cd05e3-2222-419e-b7e9-54c8c9a03d2c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:21 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:10:21 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "cinder-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "cinder-quobyte-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-quobyte-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a589eca-f3c6-4e6b-8331-6882c5e7cfe5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:10:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:22 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 Jul 11 18:10:22 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:22 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.664s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:22 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:10:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Deleted volume successfully. Jul 11 18:10:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9b30265c-acaa-463f-9dd5-0f27079bc1d9 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-c2ddb237-ffb6-4116-91c2-81b5a6434a8e-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:22 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" returned: 0 in 0.823s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:22 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51 Jul 11 18:10:22 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:23 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-quobyte-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51" released by "delete_volume" :: held 1.516s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Created reservations ['f5e82a45-b962-4fb2-8b97-a33e327afce8', '5489c021-d3fe-4307-bd6c-dc442a428017', '99899bcb-43e5-40df-a330-495ca404699e', 'b742cd93-9135-4989-a710-5838ea4c7dfd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:23 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:10:23 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:24 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.713s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:24 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:10:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Deleted volume successfully. Jul 11 18:10:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9d428856-f03d-4774-baf2-5a47556aa3f5 tempest-TestServerVolumeAttachmentScenario-386423166 None] Lock "cinder-a4b7f165-4cf7-4b79-b4ec-d66ef3b7df51-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:34 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:10:34 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:34 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.713s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:10:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:10:42 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:10:42 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Flow 'volume_create_manager' (5d67884d-3e75-44ff-89f4-1dd07658fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803a8d89-466a-43b9-93ab-0a49f83c6952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803a8d89-466a-43b9-93ab-0a49f83c6952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1018350496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d95c1f8-929b-41c7-bb9b-2e34cf065123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450985166fcf4685800bc0d7b07ed6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:10:51Z,use_quota=True,user_id='ed35ac60161d4a0f92d3be7062a8c3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1093ef43-d09f-4b99-9dd3-a3ab467489aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1093ef43-d09f-4b99-9dd3-a3ab467489aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667060ec-3afe-4213-8a13-91fcfaff514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667060ec-3afe-4213-8a13-91fcfaff514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d95c1f8-929b-41c7-bb9b-2e34cf065123', 'volume_name': 'volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47be6162-92c9-43b5-8aa3-7a5def913be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47be6162-92c9-43b5-8aa3-7a5def913be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bec686-fcee-46c6-81c7-5dcec300601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Volume 5d95c1f8-929b-41c7-bb9b-2e34cf065123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123', 'volume_size': 1} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1018350496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d95c1f8-929b-41c7-bb9b-2e34cf065123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450985166fcf4685800bc0d7b07ed6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:10:51Z,use_quota=True,user_id='ed35ac60161d4a0f92d3be7062a8c3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Creating volume 5d95c1f8-929b-41c7-bb9b-2e34cf065123 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:10:51 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:10:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:51 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 1073741824 Jul 11 18:10:51 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:52 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 1073741824" returned: 0 in 1.008s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:52 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 Jul 11 18:10:52 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:53 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bec686-fcee-46c6-81c7-5dcec300601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200eb23d-5a3e-4b7b-83e1-0752ce7c9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:10:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Volume volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 (5d95c1f8-929b-41c7-bb9b-2e34cf065123): created successfully Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200eb23d-5a3e-4b7b-83e1-0752ce7c9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:10:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Flow 'volume_create_manager' (5d67884d-3e75-44ff-89f4-1dd07658fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:10:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5ef0d815-d336-4d41-8f30-ed6c118193d4 tempest-TestMinimumBasicScenario-1972639039 None] Created volume successfully. Jul 11 18:10:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:10:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:10:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f6e6f-5149-4d95-9e94-079fb0ea9f62]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:10:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:10:57 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 Jul 11 18:10:57 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:10:58 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 11 18:10:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123" returned: 0 in 0.839s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:10:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:10:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc998311-c0b8-4d75-82ae-3881efc5bb8f', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:10:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-f8fcf034-8ea5-43a2-b5c6-e2c97463eb63 req-67236509-3f7e-46cc-b639-4a9be78e7685 tempest-TestMinimumBasicScenario-1972639039 None] attachment_update completed successfully. Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Flow 'volume_create_manager' (ce3e5abb-ca65-44a9-8cc2-99af406e7db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156198a3-9495-4258-b8ae-909d606b46c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156198a3-9495-4258-b8ae-909d606b46c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900915188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832685284a9247b8bba6e11184c4ed31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:11:01Z,use_quota=True,user_id='ad3a96a9d1104b218088850cbebffa23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c05539-c84c-45df-91a6-b1912e70622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c05539-c84c-45df-91a6-b1912e70622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba735a9-650f-45fa-9163-9971a02c5775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:00 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba735a9-650f-45fa-9163-9971a02c5775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'volume_name': 'volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf31ee5-29e8-4256-9b82-f773fe3b029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf31ee5-29e8-4256-9b82-f773fe3b029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665f1720-b2e5-4ebe-abdd-6f8e9c99a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Trying to clone b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:11:01 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95557a3b-9d44-4a45-8296-1e4151077801]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:01 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD Jul 11 18:11:01 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:02 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:02 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 is fetched for user ad3a96a9d1104b218088850cbebffa23. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:11:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b978fa22-7433-48fb-813d-20cc6272c95e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:02 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD Jul 11 18:11:02 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:03 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD" returned: 0 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900915188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832685284a9247b8bba6e11184c4ed31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:11:01Z,use_quota=True,user_id='ad3a96a9d1104b218088850cbebffa23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Creating volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:11:03 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:11:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:03 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1073741824 Jul 11 18:11:03 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:04 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1073741824" returned: 0 in 0.878s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:04 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:04 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:04 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Attempting download of 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6f314d-6728-4ef2-97fd-2045929fe918]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:05 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0 Jul 11 18:11:05 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:05 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:05 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0 Jul 11 18:11:05 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:06 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0" returned: 1 in 0.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_jxj58kh0' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:11:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f189c-2ce2-4466-8312-441bcf4d64a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:06 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD Jul 11 18:11:06 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:07 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:07 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 was qcow2, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:11:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:07 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:07 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:09 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 2.260s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:09 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0079af03-9564-4041-aa8e-9ba2e2bc7ea4_ch8_qds9devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:11:09 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Converted 112.00 MB image at 49.53 MB/s Jul 11 18:11:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:09 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1G Jul 11 18:11:09 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:10 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d 1G" returned: 0 in 0.710s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[11276cf5-4def-471b-b4cf-6cc601f90d3c]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:10 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:10 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:11 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:11 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:11 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:11 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 1 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Downloaded image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}])) to volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Temporary image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 for user ad3a96a9d1104b218088850cbebffa23 is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Marking volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Copying metadata from image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 to b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:11:11 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Creating volume glance metadata for volume b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d backed by image 0079af03-9564-4041-aa8e-9ba2e2bc7ea4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:11:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665f1720-b2e5-4ebe-abdd-6f8e9c99a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'volume_size': 1, 'image_id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4222ae180d714d0792598f22f5dd49cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0079af03-9564-4041-aa8e-9ba2e2bc7ea4', 'created_at': datetime.datetime(2026, 7, 11, 15, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 15, 47, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0079af03-9564-4041-aa8e-9ba2e2bc7ea4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333d130c-166f-4095-aeec-45b132c018d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:11:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Volume volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d (b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d): created successfully Jul 11 18:11:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333d130c-166f-4095-aeec-45b132c018d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:11:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Flow 'volume_create_manager' (ce3e5abb-ca65-44a9-8cc2-99af406e7db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:11:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d80a2acf-8d5d-4081-9208-1dca509889d2 tempest-TestShelveInstance-1352358794 None] Created volume successfully. Jul 11 18:11:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:11:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:11:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809eff8-9eac-4dd0-aed5-33cc73b12751]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:19 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:19 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:20 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.868s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:20 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:11:20 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:21 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 1 in 0.775s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:11:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.697s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:11:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49852a8b-aead-4b4e-9794-d6fd341f39c7', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:11:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-2a8cb434-9172-4c0a-b12b-5125b4a1bde0 req-bc5cf9d3-87e4-4f3c-9607-d8266aba59a6 tempest-TestShelveInstance-1352358794 None] attachment_update completed successfully. Jul 11 18:11:31 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=10,cinder:SELECT=24,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:11:31 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:34 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:11:34 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:34 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.634s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:11:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:11:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-dd461b4d-c3b1-4aca-ae83-c651d6506bdf req-485d6e7d-1fcf-4779-87f8-5d52cab1a5c1 tempest-TestMinimumBasicScenario-1972639039 None] Terminate volume connection completed successfully. Jul 11 18:11:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-dd461b4d-c3b1-4aca-ae83-c651d6506bdf req-485d6e7d-1fcf-4779-87f8-5d52cab1a5c1 tempest-TestMinimumBasicScenario-1972639039 None] Deleting attachment fc998311-c0b8-4d75-82ae-3881efc5bb8f. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "cinder-5d95c1f8-929b-41c7-bb9b-2e34cf065123-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "cinder-5d95c1f8-929b-41c7-bb9b-2e34cf065123-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "cinder-quobyte-5d95c1f8-929b-41c7-bb9b-2e34cf065123" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "cinder-quobyte-5d95c1f8-929b-41c7-bb9b-2e34cf065123" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b3df8-d223-47f6-bc49-c12f7d7b8786]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:11:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:48 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 Jul 11 18:11:48 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:49 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:49 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123 Jul 11 18:11:49 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:49 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d95c1f8-929b-41c7-bb9b-2e34cf065123" returned: 0 in 0.673s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:49 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "cinder-quobyte-5d95c1f8-929b-41c7-bb9b-2e34cf065123" released by "delete_volume" :: held 1.485s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:11:49 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Created reservations ['4784957f-0643-4fa6-985c-5289e422760f', 'ebf9fc8b-eacd-4328-a0e6-62803ec93b84', 'f37cfefd-07d6-4ed4-8c94-375263df21fd', '04f1ffbc-ee29-491b-8e0a-9370a3a96889'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:11:50 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:11:50 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:11:50 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.623s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:11:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Deleted volume successfully. Jul 11 18:11:50 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9c3f0ea3-6976-45e9-9bb9-a7a14b351588 tempest-TestMinimumBasicScenario-1972639039 None] Lock "cinder-5d95c1f8-929b-41c7-bb9b-2e34cf065123-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:11:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-5104d650-856d-472f-812a-8a65803c0cdb req-b0a5bf00-5ede-4af8-9a44-3630a0082c17 tempest-TestShelveInstance-1352358794 None] Terminate volume connection completed successfully. Jul 11 18:11:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-5104d650-856d-472f-812a-8a65803c0cdb req-b0a5bf00-5ede-4af8-9a44-3630a0082c17 tempest-TestShelveInstance-1352358794 None] Deleting attachment 49852a8b-aead-4b4e-9794-d6fd341f39c7. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:12:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:12:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:12:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbbbc58-5f57-4b5a-8226-4686f99f897b]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:12:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:03 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:12:03 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:04 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:04 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:12:04 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:04 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 1 in 0.858s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.730s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:12:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '692685c7-186a-4b36-bd5c-cf6ca2cae05c', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:12:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-79e510b1-2e19-4345-9273-59725765dd91 req-388774d8-97c5-444f-bac6-e120159a637a tempest-TestShelveInstance-1352358794 None] attachment_update completed successfully. Jul 11 18:12:14 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:12:14 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Flow 'volume_create_manager' (3482588b-5fe4-4de7-a3dc-f6ff2a78699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f9f6d5-5f9f-46d3-a200-12782cba6d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f9f6d5-5f9f-46d3-a200-12782cba6d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1728804812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784a4fb1-191c-4c95-b632-1c9bdb455ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba73d564fd440658483dbe02890ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:12:34Z,use_quota=True,user_id='844fecd39e454ce58e4785e390973a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18091a27-d513-4317-aa77-83c9c6840c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18091a27-d513-4317-aa77-83c9c6840c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e839dc6-9dcc-411a-88a6-eb85ba73089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e839dc6-9dcc-411a-88a6-eb85ba73089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784a4fb1-191c-4c95-b632-1c9bdb455ffa', 'volume_name': 'volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc55c9-df00-4cc4-a9ed-4ccd8e864ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc55c9-df00-4cc4-a9ed-4ccd8e864ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f260ff0-bd55-4854-9642-dd089be4368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Volume 784a4fb1-191c-4c95-b632-1c9bdb455ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa', 'volume_size': 1} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1728804812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784a4fb1-191c-4c95-b632-1c9bdb455ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba73d564fd440658483dbe02890ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:12:34Z,use_quota=True,user_id='844fecd39e454ce58e4785e390973a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Creating volume 784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:12:33 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:12:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:34 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa 1073741824 Jul 11 18:12:34 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:34 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:12:34 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:34 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.763s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:12:34 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa 1073741824" returned: 0 in 0.923s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:34 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:12:34 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:35 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f260ff0-bd55-4854-9642-dd089be4368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde37ac4-852c-4a6d-84d3-663fae8d47d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:12:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Volume volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa (784a4fb1-191c-4c95-b632-1c9bdb455ffa): created successfully Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde37ac4-852c-4a6d-84d3-663fae8d47d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:12:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Flow 'volume_create_manager' (3482588b-5fe4-4de7-a3dc-f6ff2a78699d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:12:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ee844ad4-8c3a-4a44-9070-e965edbacb06 tempest-TestStampPattern-1595332570 None] Created volume successfully. Jul 11 18:12:45 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:12:45 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:12:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-59463569-83ab-47b0-8d23-5793abf9806f req-843b9bd3-e06c-44a5-82a9-17a24a42a817 tempest-TestShelveInstance-1352358794 None] Terminate volume connection completed successfully. Jul 11 18:12:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-59463569-83ab-47b0-8d23-5793abf9806f req-843b9bd3-e06c-44a5-82a9-17a24a42a817 tempest-TestShelveInstance-1352358794 None] Deleting attachment 692685c7-186a-4b36-bd5c-cf6ca2cae05c. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Acquiring lock "cinder-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "cinder-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Acquiring lock "cinder-quobyte-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "cinder-quobyte-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1046f1cc-ccc7-4c2b-bbf7-82c95ca7bb8e]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:12:59 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:12:59 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:12:59 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:12:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:00 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:13:00 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:00 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 1 in 0.773s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:13:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:00 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d Jul 11 18:13:00 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:01 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" returned: 0 in 0.649s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "cinder-quobyte-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d" released by "delete_volume" :: held 2.259s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG cinder.quota [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Created reservations ['4ab0a3ad-7879-46c1-be69-18f279e5f995', '3921e3f6-854c-424b-81b0-3902407e38f3', 'a7a93cef-11c7-443e-afe9-dc9e9dc36493', '46c09de6-89c4-4862-89be-79bd5c847d56'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:01 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:01 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:02 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.712s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:02 devstack cinder-volume[86932]: DEBUG cinder.manager [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Deleted volume successfully. Jul 11 18:13:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [req-59463569-83ab-47b0-8d23-5793abf9806f req-52d4f68a-44d7-4246-8afa-37c4a7bea3b5 tempest-TestShelveInstance-1352358794 None] Lock "cinder-b0c7258f-d405-4fcc-8b2e-cbb74ddfe72d-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:11 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Flow 'volume_create_manager' (38e443f8-80e9-44c6-b3da-1675286f4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed46cc0-e24b-479d-8873-7725927f3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed46cc0-e24b-479d-8873-7725927f3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dea0cc9-f8e4-4b77-b640-e644f1f2ba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f144487808e46d68f684293b50b9586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:12Z,use_quota=True,user_id='486ae79d4af746eda894cc43285b7b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa18c3e5-eb55-46b7-aabb-6552c64fe0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa18c3e5-eb55-46b7-aabb-6552c64fe0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e976dd-8ddc-4d0f-b422-59e2a1e4880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e976dd-8ddc-4d0f-b422-59e2a1e4880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dea0cc9-f8e4-4b77-b640-e644f1f2ba68', 'volume_name': 'volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee8073-0dd5-4669-af43-b343f9ba4fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee8073-0dd5-4669-af43-b343f9ba4fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10b0a3-c940-431b-9e60-71c7c6200b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Volume 2dea0cc9-f8e4-4b77-b640-e644f1f2ba68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68', 'volume_size': 1} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dea0cc9-f8e4-4b77-b640-e644f1f2ba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f144487808e46d68f684293b50b9586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:12Z,use_quota=True,user_id='486ae79d4af746eda894cc43285b7b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Creating volume 2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:13:12 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:12 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 1073741824 Jul 11 18:13:12 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:12 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 1073741824" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:13 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 Jul 11 18:13:13 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:13 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" returned: 0 in 0.673s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10b0a3-c940-431b-9e60-71c7c6200b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f227bf3a-c252-477a-b3a6-b2152e1a2e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:13 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Volume volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 (2dea0cc9-f8e4-4b77-b640-e644f1f2ba68): created successfully Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f227bf3a-c252-477a-b3a6-b2152e1a2e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Flow 'volume_create_manager' (38e443f8-80e9-44c6-b3da-1675286f4dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-60fef07e-72a2-4401-8f0b-d4ee047e7ac3 tempest-CinderUnicodeTest-79308872 None] Created volume successfully. Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae2363-0c4e-4ab0-9d38-1bf22edd36d1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:14 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:13:14 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Flow 'volume_create_manager' (0d52e98e-7482-493a-a950-dece99eabe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc74432-b76e-43c2-a445-0912cb7360d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc74432-b76e-43c2-a445-0912cb7360d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1754394005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea08246a-ded9-46e7-a69e-dd5d3633ace4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f144487808e46d68f684293b50b9586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:15Z,use_quota=True,user_id='486ae79d4af746eda894cc43285b7b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1b6083-abf0-42e6-beec-719c2f75b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1b6083-abf0-42e6-beec-719c2f75b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ff3380-b281-44ca-9cad-c7df6327667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ff3380-b281-44ca-9cad-c7df6327667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea08246a-ded9-46e7-a69e-dd5d3633ace4', 'volume_name': 'volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7203d576-25b6-46ae-a757-e97baf2b5f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7203d576-25b6-46ae-a757-e97baf2b5f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9deae40-20a2-44ee-be5e-e3cb195452ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Volume ea08246a-ded9-46e7-a69e-dd5d3633ace4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4', 'volume_size': 1} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:14 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.815s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1754394005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea08246a-ded9-46e7-a69e-dd5d3633ace4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f144487808e46d68f684293b50b9586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:15Z,use_quota=True,user_id='486ae79d4af746eda894cc43285b7b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Creating volume ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:13:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:14 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 1073741824 Jul 11 18:13:14 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73900ca7-f505-4db9-bae7-09c9b6a0091c', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:13:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-fb8b86d6-6a60-4ae0-9d90-60e8a6187383 req-e8393056-327a-41f9-abdf-25d8519b3e2b tempest-TestStampPattern-1595332570 None] attachment_update completed successfully. Jul 11 18:13:15 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 1073741824" returned: 0 in 0.865s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:15 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 Jul 11 18:13:15 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:16 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4" returned: 0 in 0.659s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9deae40-20a2-44ee-be5e-e3cb195452ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98aaf9-00da-49a9-a60b-548fb5626d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Volume volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 (ea08246a-ded9-46e7-a69e-dd5d3633ace4): created successfully Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98aaf9-00da-49a9-a60b-548fb5626d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Flow 'volume_create_manager' (0d52e98e-7482-493a-a950-dece99eabe2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-17f35218-41b5-48c2-a0a7-e4b32a47e23c tempest-CinderUnicodeTest-79308872 None] Created volume successfully. Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Creating offline snapshot 1f86900b-10e0-4ae6-8119-55016c255a31 of volume ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f69da-c902-429b-982b-c59d93cefb05]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:17 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 Jul 11 18:13:17 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:17 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:17 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 1G Jul 11 18:13:17 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:18 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 1G" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:18 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 Jul 11 18:13:18 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:19 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31" returned: 0 in 0.742s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:19 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 is being set with open permissions: ugo+rw Jul 11 18:13:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:19 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 Jul 11 18:13:19 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:19 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31" returned: 0 in 0.660s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:19 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info Jul 11 18:13:19 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:20 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info" returned: 0 in 0.639s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:20 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info is being set with open permissions: ugo+rw Jul 11 18:13:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:20 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info Jul 11 18:13:20 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:21 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.info" returned: 0 in 0.636s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ce3e4430-5258-4d26-a128-c09b8c3ac4bf tempest-CinderUnicodeTest-79308872 None] Create snapshot completed successfully Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-1f86900b-10e0-4ae6-8119-55016c255a31-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-1f86900b-10e0-4ae6-8119-55016c255a31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-quobyte-1f86900b-10e0-4ae6-8119-55016c255a31" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-1f86900b-10e0-4ae6-8119-55016c255a31" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Deleting offline snapshot 1f86900b-10e0-4ae6-8119-55016c255a31 of volume ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] snapshot_file for this snap is: volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee103d-88bc-4d22-9563-932d09bda083]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:22 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 Jul 11 18:13:22 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:23 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31" returned: 0 in 0.795s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2723db1-86ee-42e7-91ae-bea928aa0b91]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-1420cfd5-a809-4fb2-8adb-3007b6a95534 req-9a0d1332-e774-4c60-81a0-f00a066d5e84 tempest-TestStampPattern-1595332570 None] Terminate volume connection completed successfully. Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-1420cfd5-a809-4fb2-8adb-3007b6a95534 req-9a0d1332-e774-4c60-81a0-f00a066d5e84 tempest-TestStampPattern-1595332570 None] Deleting attachment 73900ca7-f505-4db9-bae7-09c9b6a0091c. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:13:23 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 Jul 11 18:13:23 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:23 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4" returned: 0 in 0.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:23 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 Jul 11 18:13:23 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:24 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31" returned: 0 in 0.716s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:24 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31 Jul 11 18:13:24 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:25 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4.1f86900b-10e0-4ae6-8119-55016c255a31" returned: 0 in 0.660s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Creating offline snapshot 0324c136-bf37-4a4b-8e75-f4080026b7e0 of volume 784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-1f86900b-10e0-4ae6-8119-55016c255a31" released by "_delete_snapshot" :: held 3.056s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" released by "delete_snapshot" :: held 3.079s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e00bb-58a1-48f2-873c-0f8f19b16ff9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Created reservations ['5c3dad2f-9670-4e6a-883c-ac8d20b89926', 'aac3912f-6e21-4e71-b023-d9a858e6a405', '379f0517-3e52-4065-9248-3f3ac522ffa0', '6f41dd4a-ac7d-46cb-bdc4-75c6fd3fb0c4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:25 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:13:25 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Delete snapshot completed successfully. Jul 11 18:13:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4827b3ec-18b8-46ec-a029-44986178d777 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-1f86900b-10e0-4ae6-8119-55016c255a31-delete_snapshot" released by "delete_snapshot" :: held 3.235s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:26 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.735s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:26 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 1G Jul 11 18:13:26 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-ea08246a-ded9-46e7-a69e-dd5d3633ace4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-ea08246a-ded9-46e7-a69e-dd5d3633ace4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f912f7-551e-4eac-a2b7-3a25b459386e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:26 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 Jul 11 18:13:26 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:26 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 1G" returned: 0 in 0.805s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:26 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:13:26 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:27 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:27 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4 Jul 11 18:13:27 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:27 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.685s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:27 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 is being set with open permissions: ugo+rw Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:27 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:13:27 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:27 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ea08246a-ded9-46e7-a69e-dd5d3633ace4" returned: 0 in 0.652s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-ea08246a-ded9-46e7-a69e-dd5d3633ace4" released by "delete_volume" :: held 1.488s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Created reservations ['2d808315-e02a-46c3-a849-1c44ac49a7e5', 'dce60e7a-354c-4484-b8a5-73798a8c6e73', 'ffae87ee-2a72-4292-887d-c09ce400de17', 'fada4ed1-8836-4097-8c7d-4c895b49d1b3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:28 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:28 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:28 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.642s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:28 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info Jul 11 18:13:28 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "cinder-quobyte-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d60bf9-dd14-4d2a-bee4-960f8c68515d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:28 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.698s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:28 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Deleted volume successfully. Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-335f5f43-fdcb-4b94-be97-0fbd14320467 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-ea08246a-ded9-46e7-a69e-dd5d3633ace4-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:28 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info" returned: 0 in 0.666s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:28 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info is being set with open permissions: ugo+rw Jul 11 18:13:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:28 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 Jul 11 18:13:28 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:28 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info Jul 11 18:13:28 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:29 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.info" returned: 0 in 0.635s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:29 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e76f2f1a-4b68-4c29-bdd6-c1d2fba006c7 tempest-TestStampPattern-1595332570 None] Create snapshot completed successfully Jul 11 18:13:29 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68 Jul 11 18:13:29 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:30 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" returned: 0 in 0.644s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-quobyte-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68" released by "delete_volume" :: held 1.455s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Created reservations ['fdf0ec6e-25a8-46b6-ad31-ab517708b0d6', '4344478d-44d9-4286-830a-734a90dd87ab', 'b76dba04-7212-4bf9-93b0-08c557a61e1d', '48ff9112-9c5d-4899-ba1a-df008409fbca'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:30 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:30 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:30 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.655s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:30 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Deleted volume successfully. Jul 11 18:13:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5ab56951-fbbc-452d-8c41-ea317a6d4943 tempest-CinderUnicodeTest-79308872 None] Lock "cinder-2dea0cc9-f8e4-4b77-b640-e644f1f2ba68-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:34 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:34 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Flow 'volume_create_manager' (01c32090-b741-42b2-910f-db2185f4138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8cc0d8-c685-4305-8558-5ab2e94aa3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8cc0d8-c685-4305-8558-5ab2e94aa3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989342550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aa7a1d-824a-4aba-8737-0adb638a954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd9f87f14544a899d70a415fb3216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:34Z,use_quota=True,user_id='55fe1a8af128479996c6fe35a9270884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff63ac-bb11-4ca4-b6d2-47edf0168ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff63ac-bb11-4ca4-b6d2-47edf0168ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda4fa6-4fd8-4535-86b3-6c5ad5726140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda4fa6-4fd8-4535-86b3-6c5ad5726140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04aa7a1d-824a-4aba-8737-0adb638a954e', 'volume_name': 'volume-04aa7a1d-824a-4aba-8737-0adb638a954e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bfc8c8-3b20-4eb2-bc5d-4c895838e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bfc8c8-3b20-4eb2-bc5d-4c895838e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd82a14b-7718-456b-b2c3-5dfde2955e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:34 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Volume 04aa7a1d-824a-4aba-8737-0adb638a954e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04aa7a1d-824a-4aba-8737-0adb638a954e', 'volume_size': 1} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989342550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aa7a1d-824a-4aba-8737-0adb638a954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd9f87f14544a899d70a415fb3216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:34Z,use_quota=True,user_id='55fe1a8af128479996c6fe35a9270884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Creating volume 04aa7a1d-824a-4aba-8737-0adb638a954e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:13:34 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:34 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e 1073741824 Jul 11 18:13:34 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:34 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.651s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:13:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:13:35 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e 1073741824" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:35 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e Jul 11 18:13:35 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:35 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e" returned: 0 in 0.656s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd82a14b-7718-456b-b2c3-5dfde2955e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04aa7a1d-824a-4aba-8737-0adb638a954e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e368aa3b-7b4f-4532-8398-f934d5c8f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Volume volume-04aa7a1d-824a-4aba-8737-0adb638a954e (04aa7a1d-824a-4aba-8737-0adb638a954e): created successfully Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e368aa3b-7b4f-4532-8398-f934d5c8f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Flow 'volume_create_manager' (01c32090-b741-42b2-910f-db2185f4138f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-708cd224-e1df-4c77-a307-0efb7a8714ae tempest-ProjectReaderTests-1840042096 None] Created volume successfully. Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "cinder-04aa7a1d-824a-4aba-8737-0adb638a954e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-04aa7a1d-824a-4aba-8737-0adb638a954e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "cinder-quobyte-04aa7a1d-824a-4aba-8737-0adb638a954e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-quobyte-04aa7a1d-824a-4aba-8737-0adb638a954e" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4dbc1-1ce0-460a-9ffd-98560c90a775]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:36 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e Jul 11 18:13:36 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:37 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e" returned: 0 in 0.774s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:37 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e Jul 11 18:13:37 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:38 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-04aa7a1d-824a-4aba-8737-0adb638a954e" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-quobyte-04aa7a1d-824a-4aba-8737-0adb638a954e" released by "delete_volume" :: held 1.490s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Created reservations ['cc36e05a-9f1d-47a2-b594-c7dcf26541e7', '46b6afe5-def4-4352-aef2-c4bf2d80f03b', 'f6a36016-7ff1-4edb-b0c7-8700d5412652', '47dfd4f2-8884-4227-ac8f-ae36453293da'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:38 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:38 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:38 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.647s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Deleted volume successfully. Jul 11 18:13:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-20ffaba9-ce6b-4719-9b4a-0f1ff79f5c63 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-04aa7a1d-824a-4aba-8737-0adb638a954e-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Flow 'volume_create_manager' (89785127-b003-49f6-84d7-ca46ed317616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc38271d-72e1-430c-9842-1d9a98236ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc38271d-72e1-430c-9842-1d9a98236ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60281970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c8a015-8b38-45e6-8227-ae9f5afafcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd9f87f14544a899d70a415fb3216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:39Z,use_quota=True,user_id='55fe1a8af128479996c6fe35a9270884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf9548d-7b81-454f-9f4f-2126947876c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf9548d-7b81-454f-9f4f-2126947876c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755a20cf-17ee-46dd-8a53-ca0afb6a1f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755a20cf-17ee-46dd-8a53-ca0afb6a1f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c8a015-8b38-45e6-8227-ae9f5afafcd7', 'volume_name': 'volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ec5e0e-076d-4c7e-b552-ae9afe5a4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ec5e0e-076d-4c7e-b552-ae9afe5a4185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86963e16-6a49-4ff7-8aff-aa6fdb055334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Volume c8c8a015-8b38-45e6-8227-ae9f5afafcd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7', 'volume_size': 1} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60281970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c8a015-8b38-45e6-8227-ae9f5afafcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd9f87f14544a899d70a415fb3216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:39Z,use_quota=True,user_id='55fe1a8af128479996c6fe35a9270884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Creating volume c8c8a015-8b38-45e6-8227-ae9f5afafcd7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:13:39 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:13:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:39 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 1073741824 Jul 11 18:13:39 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Flow 'volume_create_manager' (e16fb85e-088a-4457-a44a-85cc11ac6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cf17a0-79d6-4cc9-abcc-1cb253aa018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:40 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 1073741824" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cf17a0-79d6-4cc9-abcc-1cb253aa018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1425129739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f6084b-ac41-4885-8b76-d3cd92266404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba73d564fd440658483dbe02890ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0324c136-bf37-4a4b-8e75-f4080026b7e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:13:40Z,use_quota=True,user_id='844fecd39e454ce58e4785e390973a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1123089f-e758-48c9-a457-749745584782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1123089f-e758-48c9-a457-749745584782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a898e3d8-7b3b-4b6a-a13f-e0a41cb22cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a898e3d8-7b3b-4b6a-a13f-e0a41cb22cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3f6084b-ac41-4885-8b76-d3cd92266404', 'volume_name': 'volume-c3f6084b-ac41-4885-8b76-d3cd92266404', 'volume_size': 1, 'snapshot_id': '0324c136-bf37-4a4b-8e75-f4080026b7e0'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51786c30-6fab-4bbc-833f-d0561e4c6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51786c30-6fab-4bbc-833f-d0561e4c6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0f9e69-8a97-48a5-a15a-f018af954b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:40 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Volume c3f6084b-ac41-4885-8b76-d3cd92266404: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3f6084b-ac41-4885-8b76-d3cd92266404', 'volume_size': 1, 'snapshot_id': '0324c136-bf37-4a4b-8e75-f4080026b7e0'} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:40 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 Jul 11 18:13:40 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:41 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.701s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0-c3f6084b-ac41-4885-8b76-d3cd92266404" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86963e16-6a49-4ff7-8aff-aa6fdb055334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9417c6-df03-4c0f-923b-fa76d2f682db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0-c3f6084b-ac41-4885-8b76-d3cd92266404" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Creating volume c3f6084b-ac41-4885-8b76-d3cd92266404 from snapshot 0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Volume volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 (c8c8a015-8b38-45e6-8227-ae9f5afafcd7): created successfully Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9417c6-df03-4c0f-923b-fa76d2f682db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Flow 'volume_create_manager' (89785127-b003-49f6-84d7-ca46ed317616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] snapshot: 0324c136-bf37-4a4b-8e75-f4080026b7e0, volume: c3f6084b-ac41-4885-8b76-d3cd92266404, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-846315c1-3bb9-471e-8de6-3c3d9449d4da tempest-ProjectReaderTests-1840042096 None] Created volume successfully. Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[25621e11-b8e7-49b3-b2b8-0c199d2c4a69]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:41 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:13:41 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "cinder-c8c8a015-8b38-45e6-8227-ae9f5afafcd7-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-c8c8a015-8b38-45e6-8227-ae9f5afafcd7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "cinder-quobyte-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-quobyte-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" acquired by "delete_volume" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f008a13e-fa44-470e-a4e7-38f058111dad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:41 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 Jul 11 18:13:41 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:42 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec560457-b0f3-4af3-b26f-69560534b8f6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:42 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:13:42 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:42 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" returned: 0 in 0.876s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:42 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7 Jul 11 18:13:42 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:42 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:13:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:42 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 Jul 11 18:13:42 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:43 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" returned: 0 in 0.679s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-quobyte-c8c8a015-8b38-45e6-8227-ae9f5afafcd7" released by "delete_volume" :: held 1.602s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Created reservations ['cedcc60c-0a8a-4eb8-a392-18b0b8c7ebf5', 'f31b43b2-8e4f-4c27-8822-b2945984abcd', '1be5720f-c567-43bd-8932-5516c8f9e896', '61c85dc5-42b2-4828-81e2-a175cdedec24'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:43 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:13:43 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:44 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.916s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:44 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:13:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Deleted volume successfully. Jul 11 18:13:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7f748b3a-ea4e-4570-9340-d42fe19d21d7 tempest-ProjectReaderTests-1840042096 None] Lock "cinder-c8c8a015-8b38-45e6-8227-ae9f5afafcd7-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:49 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404" returned: 0 in 6.276s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe6041-fe92-41dc-a4b9-0e89261386e8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:13:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:49 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:13:49 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:50 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 1.156s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:50 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:13:50 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Converted 1024.00 MB image at 163.14 MB/s Jul 11 18:13:50 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 is being set with open permissions: ugo+rw Jul 11 18:13:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:13:50 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 Jul 11 18:13:50 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:13:51 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404" returned: 0 in 0.709s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" released by "_copy_volume_from_snapshot" :: held 9.919s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0-c3f6084b-ac41-4885-8b76-d3cd92266404" released by "_create_volume_from_snapshot" :: held 9.972s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0f9e69-8a97-48a5-a15a-f018af954b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f6084b-ac41-4885-8b76-d3cd92266404', 'volume_size': 1, 'snapshot_id': '0324c136-bf37-4a4b-8e75-f4080026b7e0'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a87404-c252-441a-94f9-7e65a7d42f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:13:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Volume volume-c3f6084b-ac41-4885-8b76-d3cd92266404 (c3f6084b-ac41-4885-8b76-d3cd92266404): created successfully Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a87404-c252-441a-94f9-7e65a7d42f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:13:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Flow 'volume_create_manager' (e16fb85e-088a-4457-a44a-85cc11ac6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:13:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4b3025d5-bb63-4b2d-80ec-fa1057982397 tempest-TestStampPattern-1595332570 None] Created volume successfully. Jul 11 18:14:01 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=52,cinder:UPDATE=70,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:14:01 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=52,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:34 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:14:34 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:34 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.624s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:14:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:14:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:14:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:14:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dcf835-f5d4-4b68-b619-d0ad9e809308]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:14:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:38 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 Jul 11 18:14:38 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:39 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404" returned: 0 in 0.760s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:14:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae', 'name': 'volume-c3f6084b-ac41-4885-8b76-d3cd92266404', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a9f4524-10c3-4aa8-a9c2-22baea7c3bec', 'enforce_multipath': True} {{(pid=86932) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:14:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-a5ab212d-78c8-4457-b3e1-50ff84244a88 req-c2426fa0-f7ea-4399-85c3-b95c6a3a3fcc tempest-TestStampPattern-1595332570 None] attachment_update completed successfully. Jul 11 18:14:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [req-19415717-904f-409d-8579-02e521ac75be req-a811ca37-6cc3-472e-89cf-d514d63a534d tempest-TestStampPattern-1595332570 None] Terminate volume connection completed successfully. Jul 11 18:14:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [req-19415717-904f-409d-8579-02e521ac75be req-a811ca37-6cc3-472e-89cf-d514d63a534d tempest-TestStampPattern-1595332570 None] Deleting attachment 3a9f4524-10c3-4aa8-a9c2-22baea7c3bec. {{(pid=86932) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-c3f6084b-ac41-4885-8b76-d3cd92266404-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "cinder-c3f6084b-ac41-4885-8b76-d3cd92266404-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cacde89-6e83-41b6-a778-e8bf1ff0ebbd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:14:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:54 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 Jul 11 18:14:54 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:55 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404" returned: 0 in 0.748s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:55 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404 Jul 11 18:14:55 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:56 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c3f6084b-ac41-4885-8b76-d3cd92266404" returned: 0 in 0.648s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-c3f6084b-ac41-4885-8b76-d3cd92266404" released by "delete_volume" :: held 1.438s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Created reservations ['1ebd8339-70dc-4999-b071-b5554faaefa9', '3abfced9-1716-4d9a-9d32-0fd2901758b5', '39577136-3ecc-4bb0-92fc-4d8b8f26fc9d', '58a5b2f2-4b3d-4cc2-9dbf-1e04bdfb422a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:56 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:14:56 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:56 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.652s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:14:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Deleted volume successfully. Jul 11 18:14:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-47db0456-6bf0-407e-b3d8-07896c26b06d tempest-TestStampPattern-1595332570 None] Lock "cinder-c3f6084b-ac41-4885-8b76-d3cd92266404-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-0324c136-bf37-4a4b-8e75-f4080026b7e0-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-0324c136-bf37-4a4b-8e75-f4080026b7e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Deleting offline snapshot 0324c136-bf37-4a4b-8e75-f4080026b7e0 of volume 784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] snapshot_file for this snap is: volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c9d9b-6bb3-4e21-ab77-1b94a0c02e91]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:57 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:14:57 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:57 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.742s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efee584-4e0f-48ca-9ea6-330208f8997a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:14:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:58 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:14:58 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:58 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.742s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:58 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:14:58 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:14:59 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 11 18:14:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.704s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:14:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:14:59 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0 Jul 11 18:14:59 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:00 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa.0324c136-bf37-4a4b-8e75-f4080026b7e0" returned: 0 in 0.702s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-0324c136-bf37-4a4b-8e75-f4080026b7e0" released by "_delete_snapshot" :: held 2.989s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" released by "delete_snapshot" :: held 3.011s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Created reservations ['78eeb6e1-6a3f-49fe-acb4-e1a563bc7a68', '3acea1d5-b2de-48b8-adbb-ce9c4b9ef356', 'f2553742-8419-4a59-afe5-df1fb70547b4', 'a6d18ef9-3388-4fa9-9263-0deae907e4be'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Delete snapshot completed successfully. Jul 11 18:15:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-faa3d6e2-7c63-42e4-8ae5-911d1d2d0e57 tempest-TestStampPattern-1595332570 None] Lock "cinder-0324c136-bf37-4a4b-8e75-f4080026b7e0-delete_snapshot" released by "delete_snapshot" :: held 3.153s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-784a4fb1-191c-4c95-b632-1c9bdb455ffa-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "cinder-784a4fb1-191c-4c95-b632-1c9bdb455ffa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Acquiring lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" acquired by "delete_volume" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5367fe0-104f-42dc-9118-745092d47321]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:09 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:15:09 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:10 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.730s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:10 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa Jul 11 18:15:10 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:10 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-784a4fb1-191c-4c95-b632-1c9bdb455ffa" returned: 0 in 0.635s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "cinder-quobyte-784a4fb1-191c-4c95-b632-1c9bdb455ffa" released by "delete_volume" :: held 1.416s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Created reservations ['6c0ab1e9-6b95-4154-b040-2fd83d6bd956', 'da8411c6-a897-4a87-add5-7ab0e6cc3954', '167bfe93-ba79-485b-a867-5b28866b687b', '9b48900c-cf3b-4ace-8fb4-81a58358eb51'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:10 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:10 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:11 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.642s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:11 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Deleted volume successfully. Jul 11 18:15:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34793990-5841-497e-b578-5847c2d0ae77 tempest-TestStampPattern-1595332570 None] Lock "cinder-784a4fb1-191c-4c95-b632-1c9bdb455ffa-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:20 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (54bcad96-9b74-4aff-a0a7-59f99d63e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd11689-490d-40aa-adc7-aa9dedee2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd11689-490d-40aa-adc7-aa9dedee2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805162243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db1860f-b8d4-4377-b918-0df5ba2d6142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:21Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a4f8c9-c796-4630-bba0-c9b68c2d6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a4f8c9-c796-4630-bba0-c9b68c2d6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e2e55-ed53-4f31-8b67-fc52cd62eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e2e55-ed53-4f31-8b67-fc52cd62eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db1860f-b8d4-4377-b918-0df5ba2d6142', 'volume_name': 'volume-4db1860f-b8d4-4377-b918-0df5ba2d6142', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40734244-cd31-4475-b414-08790effb62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40734244-cd31-4475-b414-08790effb62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e8ec54-7dc4-4000-8862-281abf5633b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:21 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume 4db1860f-b8d4-4377-b918-0df5ba2d6142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db1860f-b8d4-4377-b918-0df5ba2d6142', 'volume_size': 1} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805162243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db1860f-b8d4-4377-b918-0df5ba2d6142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:21Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume 4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:21 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:21 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 1073741824 Jul 11 18:15:21 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:22 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 1073741824" returned: 0 in 0.790s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:22 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 Jul 11 18:15:22 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:22 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142" returned: 0 in 0.617s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e8ec54-7dc4-4000-8862-281abf5633b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db1860f-b8d4-4377-b918-0df5ba2d6142', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae351433-6cdd-4521-9b7e-b4f9a33a7b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:22 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 (4db1860f-b8d4-4377-b918-0df5ba2d6142): created successfully Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae351433-6cdd-4521-9b7e-b4f9a33a7b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (54bcad96-9b74-4aff-a0a7-59f99d63e404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9a71dbfa-b2ba-42f6-804f-567736ed955f tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating offline snapshot e8f7f0e3-1dbd-4689-be0e-28735c956328 of volume 4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:15:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1806b55-516b-433d-bc5a-071a9daecafc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:23 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 Jul 11 18:15:23 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:24 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142" returned: 0 in 0.727s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:24 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 1G Jul 11 18:15:24 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:24 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 1G" returned: 0 in 0.753s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:24 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 Jul 11 18:15:24 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:25 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:25 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 is being set with open permissions: ugo+rw Jul 11 18:15:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:25 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 Jul 11 18:15:25 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:26 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328" returned: 0 in 0.611s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:26 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info Jul 11 18:15:26 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:26 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info" returned: 0 in 0.620s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:26 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info is being set with open permissions: ugo+rw Jul 11 18:15:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:26 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info Jul 11 18:15:26 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:27 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.info" returned: 0 in 0.624s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.069s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-07fea521-a5bf-475e-92e1-46acfee1a0f3 tempest-CreateVolumesFromSnapshotTest-85591942 None] Create snapshot completed successfully Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (325b01bc-fad8-443e-bfeb-41192adf40c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bae23ff-0b8c-4077-b69e-d8373232f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bae23ff-0b8c-4077-b69e-d8373232f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905451202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b710cfa-78fe-4c8d-8f48-82ad40862ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:29Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6397591a-a8aa-41c6-8333-b44aa5c7dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6397591a-a8aa-41c6-8333-b44aa5c7dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66cea9b-27ee-4551-9a6b-8719ef69460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66cea9b-27ee-4551-9a6b-8719ef69460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b710cfa-78fe-4c8d-8f48-82ad40862ad2', 'volume_name': 'volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9a6944-22c5-48cc-99fe-e51ddcac550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9a6944-22c5-48cc-99fe-e51ddcac550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786b6dd1-a461-4fb4-9f02-f3e344e2514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume 2b710cfa-78fe-4c8d-8f48-82ad40862ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2', 'volume_size': 1} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905451202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b710cfa-78fe-4c8d-8f48-82ad40862ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:29Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume 2b710cfa-78fe-4c8d-8f48-82ad40862ad2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:29 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:29 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 1073741824 Jul 11 18:15:29 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (218a9093-5672-4fbf-bc3e-6cc898b5ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afaf35c-5378-4016-a05a-09948f92d873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afaf35c-5378-4016-a05a-09948f92d873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96495966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c13a4-085d-418a-8615-4f6566e67975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:29Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1109f5e1-7e09-41c1-801d-12ccf01fa516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1109f5e1-7e09-41c1-801d-12ccf01fa516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44ce33-891a-48c2-9c28-3ecf9db1dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44ce33-891a-48c2-9c28-3ecf9db1dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5c13a4-085d-418a-8615-4f6566e67975', 'volume_name': 'volume-7c5c13a4-085d-418a-8615-4f6566e67975', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa1b9e2-32f6-483b-b1d5-ee246b03df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa1b9e2-32f6-483b-b1d5-ee246b03df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe30523-e0dc-4854-bafc-5910ea11a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume 7c5c13a4-085d-418a-8615-4f6566e67975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5c13a4-085d-418a-8615-4f6566e67975', 'volume_size': 1} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (e9df531b-6bce-4f21-ab21-70fd5f9256ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3053a3d3-b69c-40aa-8d1f-6102e045aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3053a3d3-b69c-40aa-8d1f-6102e045aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584779621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d96f5c-6260-4f62-955d-cb78e7640a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c672ba79-5416-41ec-9af4-6bc407452ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c672ba79-5416-41ec-9af4-6bc407452ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbb21f2-0365-4242-b31c-143372b87b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbb21f2-0365-4242-b31c-143372b87b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d96f5c-6260-4f62-955d-cb78e7640a05', 'volume_name': 'volume-b4d96f5c-6260-4f62-955d-cb78e7640a05', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de961631-acdc-46ff-b83c-470b9101068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de961631-acdc-46ff-b83c-470b9101068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7f76b-0728-476e-bbc8-a4e93c45f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume b4d96f5c-6260-4f62-955d-cb78e7640a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d96f5c-6260-4f62-955d-cb78e7640a05', 'volume_size': 1} Jul 11 18:15:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:30 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 1073741824" returned: 0 in 0.930s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:30 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 Jul 11 18:15:30 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (1e98b2e8-6514-4107-8bf9-d3f14640c195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a77e74-5f4d-49dd-8f45-becc3bd63081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a77e74-5f4d-49dd-8f45-becc3bd63081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2099142210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1405f7-a8ed-47e1-913a-6e3f9fe33012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f87ef5c-b598-4d7e-ac1b-8e338ca6b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f87ef5c-b598-4d7e-ac1b-8e338ca6b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e6db80-6bcb-49c1-a433-d0dca44d0cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e6db80-6bcb-49c1-a433-d0dca44d0cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1405f7-a8ed-47e1-913a-6e3f9fe33012', 'volume_name': 'volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79eeef-7afa-4064-a24d-8328a8b68e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79eeef-7afa-4064-a24d-8328a8b68e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f619aed-96ca-4234-a83b-0f1734472a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume 1d1405f7-a8ed-47e1-913a-6e3f9fe33012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012', 'volume_size': 1} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (c88397f7-5cd7-4be8-ba0d-c4ebe5f37e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9958814-f513-4f1a-9a4d-9739390ae72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9958814-f513-4f1a-9a4d-9739390ae72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843036920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e45abd-a485-4e68-bf9c-4a6b11dca229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386d88d5-fa0e-4d47-899a-f02e926b343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386d88d5-fa0e-4d47-899a-f02e926b343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a405231-4e12-49ee-86a9-6a88838ca940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a405231-4e12-49ee-86a9-6a88838ca940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e45abd-a485-4e68-bf9c-4a6b11dca229', 'volume_name': 'volume-66e45abd-a485-4e68-bf9c-4a6b11dca229', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feedfa47-f836-44c6-9d2f-b66ccba85f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feedfa47-f836-44c6-9d2f-b66ccba85f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d13f9c-7af4-44e2-b673-880c4d16acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume 66e45abd-a485-4e68-bf9c-4a6b11dca229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e45abd-a485-4e68-bf9c-4a6b11dca229', 'volume_size': 1} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:30 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" returned: 0 in 0.682s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.290s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96495966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c13a4-085d-418a-8615-4f6566e67975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:29Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume 7c5c13a4-085d-418a-8615-4f6566e67975 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:30 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 1073741824 Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786b6dd1-a461-4fb4-9f02-f3e344e2514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14a106-d5c9-47c0-9255-50210005b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 (2b710cfa-78fe-4c8d-8f48-82ad40862ad2): created successfully Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14a106-d5c9-47c0-9255-50210005b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (325b01bc-fad8-443e-bfeb-41192adf40c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5e6de68f-b260-4162-a771-4015f4134e1c tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:31 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 1073741824" returned: 0 in 0.786s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:31 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=37,cinder:SELECT=28,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:15:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:31 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 Jul 11 18:15:31 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:32 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975" returned: 0 in 0.616s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584779621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d96f5c-6260-4f62-955d-cb78e7640a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume b4d96f5c-6260-4f62-955d-cb78e7640a05 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:32 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe30523-e0dc-4854-bafc-5910ea11a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5c13a4-085d-418a-8615-4f6566e67975', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:32 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 1073741824 Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f7898-918b-4f60-9cbf-b820f6622e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:32 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-7c5c13a4-085d-418a-8615-4f6566e67975 (7c5c13a4-085d-418a-8615-4f6566e67975): created successfully Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f7898-918b-4f60-9cbf-b820f6622e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (218a9093-5672-4fbf-bc3e-6cc898b5ce54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-91b73ad5-7f4f-46e0-955d-3c807b59db56 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:33 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 1073741824" returned: 0 in 0.779s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:33 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 Jul 11 18:15:33 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:33 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05" returned: 0 in 0.649s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.508s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2099142210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1405f7-a8ed-47e1-913a-6e3f9fe33012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume 1d1405f7-a8ed-47e1-913a-6e3f9fe33012 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:33 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:33 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 1073741824 Jul 11 18:15:33 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7f76b-0728-476e-bbc8-a4e93c45f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d96f5c-6260-4f62-955d-cb78e7640a05', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3850df-eae4-4d67-a694-2e7be8c03844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 (b4d96f5c-6260-4f62-955d-cb78e7640a05): created successfully Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3850df-eae4-4d67-a694-2e7be8c03844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (e9df531b-6bce-4f21-ab21-70fd5f9256ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f42753e9-1432-406c-b888-f165420ffde1 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:34 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:34 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:34 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 1073741824" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:34 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 Jul 11 18:15:34 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:34 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.702s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:15:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:15:35 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" returned: 0 in 0.656s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.679s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843036920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e45abd-a485-4e68-bf9c-4a6b11dca229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6c33f5c143a097de76f107158b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:15:30Z,use_quota=True,user_id='b2c548e48bbe4e0a80c80ac3bb025e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Creating volume 66e45abd-a485-4e68-bf9c-4a6b11dca229 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:15:35 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f619aed-96ca-4234-a83b-0f1734472a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:35 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 1073741824 Jul 11 18:15:35 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5baec5-ef34-453b-aed8-6a88f5719651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 (1d1405f7-a8ed-47e1-913a-6e3f9fe33012): created successfully Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5baec5-ef34-453b-aed8-6a88f5719651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (1e98b2e8-6514-4107-8bf9-d3f14640c195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:35 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-410d242d-dacd-443a-b6b3-af9cae628d36 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:36 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 1073741824" returned: 0 in 0.818s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:36 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 Jul 11 18:15:36 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:36 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229" returned: 0 in 0.610s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d13f9c-7af4-44e2-b673-880c4d16acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e45abd-a485-4e68-bf9c-4a6b11dca229', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5104be57-b94b-4760-981b-1bee361810cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:15:36 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Volume volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 (66e45abd-a485-4e68-bf9c-4a6b11dca229): created successfully Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5104be57-b94b-4760-981b-1bee361810cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:15:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Flow 'volume_create_manager' (c88397f7-5cd7-4be8-ba0d-c4ebe5f37e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:15:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0ed057b3-5fbb-4106-9e92-07df531a5209 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created volume successfully. Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-66e45abd-a485-4e68-bf9c-4a6b11dca229-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-66e45abd-a485-4e68-bf9c-4a6b11dca229-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-66e45abd-a485-4e68-bf9c-4a6b11dca229" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-66e45abd-a485-4e68-bf9c-4a6b11dca229" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de4778-ee97-411a-aa3c-7209127f0d0f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:37 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 Jul 11 18:15:37 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:37 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:37 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229 Jul 11 18:15:37 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:38 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-66e45abd-a485-4e68-bf9c-4a6b11dca229" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-66e45abd-a485-4e68-bf9c-4a6b11dca229" released by "delete_volume" :: held 1.446s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['88644f33-5a9a-4fd7-a1a7-c5a033a61566', 'e009406e-b91e-4d3b-91fd-bca16d3c5d2c', '58903a8a-8eea-4212-9ae2-c91b5cfd1717', '1d4d79f0-847d-4448-9110-f9e6955e434e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:38 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:38 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-1d1405f7-a8ed-47e1-913a-6e3f9fe33012-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-1d1405f7-a8ed-47e1-913a-6e3f9fe33012-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:39 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.660s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-69cd132e-fa78-4240-85cf-ab76f74f931e tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-66e45abd-a485-4e68-bf9c-4a6b11dca229-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86fe45-8f6d-4192-afd6-df430cae56bd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:39 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 Jul 11 18:15:39 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:40 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" returned: 0 in 0.773s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:40 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012 Jul 11 18:15:40 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:40 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" returned: 0 in 0.687s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-1d1405f7-a8ed-47e1-913a-6e3f9fe33012" released by "delete_volume" :: held 1.501s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['be1a2d6e-6efa-4223-b998-084ee98bc38f', 'e1b56f02-2262-43ca-8bfa-fbbafdf2d48b', '7b1c8940-ba47-4a15-8e3c-8f91822c3610', '24f24e74-5a3a-4958-abea-9921912ad5bf'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:40 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:40 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-b4d96f5c-6260-4f62-955d-cb78e7640a05-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-b4d96f5c-6260-4f62-955d-cb78e7640a05-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-b4d96f5c-6260-4f62-955d-cb78e7640a05" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-b4d96f5c-6260-4f62-955d-cb78e7640a05" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3daa45-b786-43ac-b64d-8a0877c8f205]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:41 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.710s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-27e8d1ab-5a70-47ca-8ec2-62f96d9d50cb tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-1d1405f7-a8ed-47e1-913a-6e3f9fe33012-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:41 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 Jul 11 18:15:41 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:42 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05" returned: 0 in 0.754s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:42 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05 Jul 11 18:15:42 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:42 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b4d96f5c-6260-4f62-955d-cb78e7640a05" returned: 0 in 0.658s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-b4d96f5c-6260-4f62-955d-cb78e7640a05" released by "delete_volume" :: held 1.455s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['c9cecc93-746f-40e1-a002-59bc06f99f14', '36afa221-d76f-4105-b43a-f6b0f6157a26', '36976c87-e40f-49ff-bcd5-ff877b0011d8', '7f1caebd-8949-45be-a7f0-2d7dd4c8b3ce'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:43 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:43 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-7c5c13a4-085d-418a-8615-4f6566e67975-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-7c5c13a4-085d-418a-8615-4f6566e67975-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-7c5c13a4-085d-418a-8615-4f6566e67975" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-7c5c13a4-085d-418a-8615-4f6566e67975" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232e5e4-4cd9-474f-844c-2ae6db244380]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:43 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.718s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-87a29243-aad8-4e15-a07b-701252f02739 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-b4d96f5c-6260-4f62-955d-cb78e7640a05-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:43 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 Jul 11 18:15:43 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:44 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:44 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975 Jul 11 18:15:44 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:45 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7c5c13a4-085d-418a-8615-4f6566e67975" returned: 0 in 0.626s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-7c5c13a4-085d-418a-8615-4f6566e67975" released by "delete_volume" :: held 1.460s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['ef3ba061-3179-41f8-9563-d68b75021859', '869c52bf-40ed-4370-86bc-7739d79d4582', 'adc9d6b2-1ca2-4a94-9b9f-60581a45339b', '46bed74a-9367-4e63-a3a9-443a279d0a33'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:45 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:45 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-2b710cfa-78fe-4c8d-8f48-82ad40862ad2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-2b710cfa-78fe-4c8d-8f48-82ad40862ad2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:45 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.651s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-7ee57b5a-dfa1-4c15-b109-85a9e3a9037f tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-7c5c13a4-085d-418a-8615-4f6566e67975-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3289956-6392-46b5-81ff-b947d2216daf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:46 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 Jul 11 18:15:46 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:46 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:46 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2 Jul 11 18:15:46 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:47 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-2b710cfa-78fe-4c8d-8f48-82ad40862ad2" released by "delete_volume" :: held 1.494s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['c8d76018-5d9c-4933-ad98-4d8d1bcf38d7', 'b95b86e0-82a7-44f4-8880-d4bb545c9c11', '3ead7e9a-7ee5-4f3a-ba2b-5c950e73a8ff', '218db52b-953a-4bec-9382-eed994f3281a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:47 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:47 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-e8f7f0e3-1dbd-4689-be0e-28735c956328-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-e8f7f0e3-1dbd-4689-be0e-28735c956328-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-e8f7f0e3-1dbd-4689-be0e-28735c956328" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-e8f7f0e3-1dbd-4689-be0e-28735c956328" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleting offline snapshot e8f7f0e3-1dbd-4689-be0e-28735c956328 of volume 4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] snapshot_file for this snap is: volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d91bb-8ab2-4d7c-a21d-d0d1b1df64ad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:48 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.713s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:48 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:48 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 Jul 11 18:15:48 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:48 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c85ffe49-4d53-46eb-9a8f-6101118167a7 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-2b710cfa-78fe-4c8d-8f48-82ad40862ad2-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:49 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328" returned: 0 in 0.740s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db1860f-b8d4-4377-b918-0df5ba2d6142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa23f4-7385-4798-8d28-689fa1a97719]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:49 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 Jul 11 18:15:49 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:49 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142" returned: 0 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:49 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 Jul 11 18:15:49 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:50 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328" returned: 0 in 0.702s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:50 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328 Jul 11 18:15:50 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:51 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142.e8f7f0e3-1dbd-4689-be0e-28735c956328" returned: 0 in 0.636s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-e8f7f0e3-1dbd-4689-be0e-28735c956328" released by "_delete_snapshot" :: held 2.936s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" released by "delete_snapshot" :: held 2.964s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['54cd67f5-8738-42a6-9075-7cdaf5190ae7', '055d8fbf-306a-4bc6-b14c-24ed2587cff4', '41f6b1f0-3b05-49fb-8af1-c27f55a6a6d0', '0f5a7ea4-e8cf-4f72-9f16-c4ef397dbad3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Delete snapshot completed successfully. Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-03abe9e1-cfa7-4946-938e-20a48806a366 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-e8f7f0e3-1dbd-4689-be0e-28735c956328-delete_snapshot" released by "delete_snapshot" :: held 3.092s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-4db1860f-b8d4-4377-b918-0df5ba2d6142-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-4db1860f-b8d4-4377-b918-0df5ba2d6142-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34831c9-6afd-460c-beb6-eb83b415d410]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:15:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:51 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 Jul 11 18:15:51 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:52 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142" returned: 0 in 0.752s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:52 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142 Jul 11 18:15:52 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:52 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4db1860f-b8d4-4377-b918-0df5ba2d6142" returned: 0 in 0.622s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-quobyte-4db1860f-b8d4-4377-b918-0df5ba2d6142" released by "delete_volume" :: held 1.428s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Created reservations ['ebb62256-f148-4df9-aaaf-8932e2b743c1', '810f6fed-9748-42ea-bd9d-6dbeb34814d5', 'afdc4a82-9b21-40eb-b920-67fb3296fb29', 'deb447d5-d30c-44d4-9105-f1fc74c26ecd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:15:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:15:52 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:15:52 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:15:53 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 11 18:15:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:15:53 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:15:53 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Deleted volume successfully. Jul 11 18:15:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-60cd6969-f4b7-4a04-8595-617e80850194 tempest-CreateVolumesFromSnapshotTest-85591942 None] Lock "cinder-4db1860f-b8d4-4377-b918-0df5ba2d6142-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:02 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=51,cinder:UPDATE=70,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:16:03 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=66,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (32c065f6-5c93-4429-baa3-a8e66c5e7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d415bd4-c5f9-493d-a373-2ce8201088ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d415bd4-c5f9-493d-a373-2ce8201088ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551652905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa03ef48-f89c-4b82-a7ca-e268df414673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:05Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402deeb-3833-4f35-ad1d-b6089d36845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402deeb-3833-4f35-ad1d-b6089d36845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da77f85-6d87-45f2-baaf-c7076e68a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da77f85-6d87-45f2-baaf-c7076e68a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa03ef48-f89c-4b82-a7ca-e268df414673', 'volume_name': 'volume-aa03ef48-f89c-4b82-a7ca-e268df414673', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d40d996-3bb4-4ca4-b9ad-4afc4b92672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d40d996-3bb4-4ca4-b9ad-4afc4b92672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df085849-a518-4277-8edc-f6e8af8c2ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Volume aa03ef48-f89c-4b82-a7ca-e268df414673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa03ef48-f89c-4b82-a7ca-e268df414673', 'volume_size': 1} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551652905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa03ef48-f89c-4b82-a7ca-e268df414673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:05Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Creating volume aa03ef48-f89c-4b82-a7ca-e268df414673 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:04 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:04 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 1073741824 Jul 11 18:16:04 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:05 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 1073741824" returned: 0 in 0.805s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:05 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 Jul 11 18:16:05 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:06 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673" returned: 0 in 0.627s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df085849-a518-4277-8edc-f6e8af8c2ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa03ef48-f89c-4b82-a7ca-e268df414673', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f26581-f1cf-4a10-9fd4-e084bf44d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:06 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Volume volume-aa03ef48-f89c-4b82-a7ca-e268df414673 (aa03ef48-f89c-4b82-a7ca-e268df414673): created successfully Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f26581-f1cf-4a10-9fd4-e084bf44d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (32c065f6-5c93-4429-baa3-a8e66c5e7eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fbe18ab4-b660-4aa9-8edb-5bfdfc0f523d tempest-ProjectReaderTests-643167789 None] Created volume successfully. Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-aa03ef48-f89c-4b82-a7ca-e268df414673-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "cinder-aa03ef48-f89c-4b82-a7ca-e268df414673-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-quobyte-aa03ef48-f89c-4b82-a7ca-e268df414673" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-aa03ef48-f89c-4b82-a7ca-e268df414673" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa434a3-816c-42a2-851d-95808b0953d7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:07 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 Jul 11 18:16:07 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:07 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:07 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673 Jul 11 18:16:07 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:08 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa03ef48-f89c-4b82-a7ca-e268df414673" returned: 0 in 0.614s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-aa03ef48-f89c-4b82-a7ca-e268df414673" released by "delete_volume" :: held 1.392s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Created reservations ['f95bb037-80b4-4b30-88b5-b9f77e8fbbc6', '5e490383-c3f4-4293-8b0f-569b657e908a', '9a569d65-c431-432f-b788-391dace1c000', '57f26bae-1d6c-4785-a829-72a91b5c08c8'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:08 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:08 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:09 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Deleted volume successfully. Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6fd719f9-1daf-4858-9db0-904cc0c92b34 tempest-ProjectReaderTests-643167789 None] Lock "cinder-aa03ef48-f89c-4b82-a7ca-e268df414673-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (920d1c82-33f6-4e84-b9ac-60f92b220be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e081b41-8297-4ed4-99d0-108a0e726d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e081b41-8297-4ed4-99d0-108a0e726d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447935390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:09Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a751c55-adf7-4ddf-9157-d7e6d5ea8cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a751c55-adf7-4ddf-9157-d7e6d5ea8cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1978479-085e-45f5-b268-242c555fd380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1978479-085e-45f5-b268-242c555fd380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7', 'volume_name': 'volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac909f-af1a-43d5-8b99-c2f90e527212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac909f-af1a-43d5-8b99-c2f90e527212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804a9589-e31f-4d4f-a6b4-ab77d90528d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Volume a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7', 'volume_size': 1} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447935390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:09Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Creating volume a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:09 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:09 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 1073741824 Jul 11 18:16:09 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:10 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 1073741824" returned: 0 in 0.780s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:10 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 Jul 11 18:16:10 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:10 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" returned: 0 in 0.615s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804a9589-e31f-4d4f-a6b4-ab77d90528d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ddfdaf-ad74-4610-ad85-a7b4905d3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:11 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Volume volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 (a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7): created successfully Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ddfdaf-ad74-4610-ad85-a7b4905d3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (920d1c82-33f6-4e84-b9ac-60f92b220be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ae202421-a6c6-44bd-a3d0-888f69712a39 tempest-ProjectReaderTests-643167789 None] Created volume successfully. Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "cinder-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-quobyte-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a43a7-fe4a-4844-9175-838b00482f07]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:11 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 Jul 11 18:16:11 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:12 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" returned: 0 in 0.724s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:12 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7 Jul 11 18:16:12 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:13 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7" released by "delete_volume" :: held 1.403s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Created reservations ['ad609967-4db6-4b9f-aa8c-04dd244afe3f', 'e111b5e0-3b61-43a9-9524-bc62c9b30d55', '2423d77a-89e3-47ca-bec3-4d3edf7428ac', '93aaeb76-589a-43d5-b3b6-9691c7470e90'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:13 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:13 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:13 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:13 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Deleted volume successfully. Jul 11 18:16:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-14985a69-eb91-4568-ae11-6a22869f7db6 tempest-ProjectReaderTests-643167789 None] Lock "cinder-a03cc5be-5ecf-4a15-9aa2-b5959d3a87e7-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (21809684-8dd8-42af-b45c-df0577eb49e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bd5208-2dc6-496e-9ec2-344cc3d57f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bd5208-2dc6-496e-9ec2-344cc3d57f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998164048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2deb10-fe5d-4c68-834a-99b411b578ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:14Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f422fc6-41d8-43f2-bc54-3bd7aad0784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f422fc6-41d8-43f2-bc54-3bd7aad0784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b50acff-32c1-4a06-b2d0-80396aaa2968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b50acff-32c1-4a06-b2d0-80396aaa2968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2deb10-fe5d-4c68-834a-99b411b578ba', 'volume_name': 'volume-9d2deb10-fe5d-4c68-834a-99b411b578ba', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69bd1db-e15d-4777-b17f-dc3c68e94fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69bd1db-e15d-4777-b17f-dc3c68e94fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8dab00-3c22-4cab-bcbc-6c482bac7f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:14 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Volume 9d2deb10-fe5d-4c68-834a-99b411b578ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2deb10-fe5d-4c68-834a-99b411b578ba', 'volume_size': 1} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998164048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2deb10-fe5d-4c68-834a-99b411b578ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:14Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Creating volume 9d2deb10-fe5d-4c68-834a-99b411b578ba {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:14 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba 1073741824 Jul 11 18:16:14 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:15 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba 1073741824" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:15 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba Jul 11 18:16:15 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:15 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba" returned: 0 in 0.626s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8dab00-3c22-4cab-bcbc-6c482bac7f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2deb10-fe5d-4c68-834a-99b411b578ba', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a0126b-9f1b-4b77-97be-f075870be1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:15 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Volume volume-9d2deb10-fe5d-4c68-834a-99b411b578ba (9d2deb10-fe5d-4c68-834a-99b411b578ba): created successfully Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a0126b-9f1b-4b77-97be-f075870be1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:15 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (21809684-8dd8-42af-b45c-df0577eb49e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d60201b2-7594-43c2-b9d0-9eb815ee424f tempest-ProjectReaderTests-643167789 None] Created volume successfully. Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-9d2deb10-fe5d-4c68-834a-99b411b578ba-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "cinder-9d2deb10-fe5d-4c68-834a-99b411b578ba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-quobyte-9d2deb10-fe5d-4c68-834a-99b411b578ba" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-9d2deb10-fe5d-4c68-834a-99b411b578ba" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a134a-5b18-4b7a-ac69-5089cce635eb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:16 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba Jul 11 18:16:16 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:17 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba" returned: 0 in 0.737s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:17 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba Jul 11 18:16:17 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:17 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9d2deb10-fe5d-4c68-834a-99b411b578ba" returned: 0 in 0.655s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-9d2deb10-fe5d-4c68-834a-99b411b578ba" released by "delete_volume" :: held 1.429s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Created reservations ['73fa8a95-4bbf-4671-b558-90a16212b17e', 'a89c1fdb-3cf3-4819-8a5c-0f23a08f294a', 'd2e8ac69-1dfc-4ca3-9e22-4b7c4c47cba0', '67036ff9-6487-421c-926c-4dd60a37befd'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:17 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:17 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:18 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.621s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:18 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:18 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Deleted volume successfully. Jul 11 18:16:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-946d72d9-6fb7-4d8f-8947-ec9889e9de2d tempest-ProjectReaderTests-643167789 None] Lock "cinder-9d2deb10-fe5d-4c68-834a-99b411b578ba-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (a9e523f9-3915-448b-bc31-9d4aa2d58aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820053ca-157e-40a0-9350-066c6661b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820053ca-157e-40a0-9350-066c6661b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171435701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd60d1e1-53aa-429f-888a-34331010bf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:19Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d184aa84-4681-485b-8412-d816bbc43886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d184aa84-4681-485b-8412-d816bbc43886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b95681-05a5-4613-87b6-8c93e441bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b95681-05a5-4613-87b6-8c93e441bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd60d1e1-53aa-429f-888a-34331010bf5f', 'volume_name': 'volume-bd60d1e1-53aa-429f-888a-34331010bf5f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d6a38-774d-418b-9b93-7354c2729c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d6a38-774d-418b-9b93-7354c2729c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0deec09c-89da-42fa-b324-0067ac7dc49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Volume bd60d1e1-53aa-429f-888a-34331010bf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd60d1e1-53aa-429f-888a-34331010bf5f', 'volume_size': 1} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171435701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd60d1e1-53aa-429f-888a-34331010bf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add6d1680562409fb6502f5ecd06885e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:19Z,use_quota=True,user_id='6a7d8df94ad748c0bd83ebf1c9f449f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Creating volume bd60d1e1-53aa-429f-888a-34331010bf5f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:19 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:19 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f 1073741824 Jul 11 18:16:19 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:19 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f 1073741824" returned: 0 in 0.804s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:19 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f Jul 11 18:16:19 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:20 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f" returned: 0 in 0.637s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0deec09c-89da-42fa-b324-0067ac7dc49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd60d1e1-53aa-429f-888a-34331010bf5f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b987e4a-abba-478c-916e-12ca9d6f0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Volume volume-bd60d1e1-53aa-429f-888a-34331010bf5f (bd60d1e1-53aa-429f-888a-34331010bf5f): created successfully Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b987e4a-abba-478c-916e-12ca9d6f0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Flow 'volume_create_manager' (a9e523f9-3915-448b-bc31-9d4aa2d58aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-001c48ab-66cc-4093-8114-c0f0f77898c2 tempest-ProjectReaderTests-643167789 None] Created volume successfully. Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-bd60d1e1-53aa-429f-888a-34331010bf5f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "cinder-bd60d1e1-53aa-429f-888a-34331010bf5f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Acquiring lock "cinder-quobyte-bd60d1e1-53aa-429f-888a-34331010bf5f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-bd60d1e1-53aa-429f-888a-34331010bf5f" acquired by "delete_volume" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88211ab-d38c-478e-9643-4775c38a5efc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:21 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f Jul 11 18:16:21 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:21 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f" returned: 0 in 0.744s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:21 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f Jul 11 18:16:21 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:22 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bd60d1e1-53aa-429f-888a-34331010bf5f" returned: 0 in 0.628s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "cinder-quobyte-bd60d1e1-53aa-429f-888a-34331010bf5f" released by "delete_volume" :: held 1.412s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Created reservations ['108f19df-215c-4a8f-b969-0f8a83c75944', '29161259-f085-4a5f-9e64-ed03c841bd4a', 'a7b0d3b4-2ce2-467f-b32d-5c290fc36400', '87d6d08e-2a3a-47fb-98c9-7956da4a5bd7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:22 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:22 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:23 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.663s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:23 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Deleted volume successfully. Jul 11 18:16:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ca0bd39d-536d-419c-a65f-66586bdc5fb1 tempest-ProjectReaderTests-643167789 None] Lock "cinder-bd60d1e1-53aa-429f-888a-34331010bf5f-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:33 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:34 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:34 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:34 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (e0eb84a2-13c8-4c93-ae78-028bd0b9b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf83d70-018f-40fa-aee0-4cd2934ba2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf83d70-018f-40fa-aee0-4cd2934ba2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585363491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:35Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061cb651-e096-4798-9f50-3391e52eb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061cb651-e096-4798-9f50-3391e52eb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772a65a5-47e0-4d74-8dc8-5b2fa5dcc6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772a65a5-47e0-4d74-8dc8-5b2fa5dcc6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9', 'volume_name': 'volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f94848-5d92-4dfd-a40f-39fd54337cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f94848-5d92-4dfd-a40f-39fd54337cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55d2806-9f0f-484f-9ad9-353506db7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume 7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9', 'volume_size': 1} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585363491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:35Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume 7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:35 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:35 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 1073741824 Jul 11 18:16:35 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (bf32eaa4-106b-4242-8549-4effe2522823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68de9efd-a8f8-4f47-9c43-185b5d6c629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68de9efd-a8f8-4f47-9c43-185b5d6c629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-539485829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75429fa-5ad6-44be-bc32-ede61e5763b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:35Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315da9eb-60a7-47a3-b3d2-98134737d21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315da9eb-60a7-47a3-b3d2-98134737d21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d740430f-fed6-4770-b4c9-857584e8ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d740430f-fed6-4770-b4c9-857584e8ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75429fa-5ad6-44be-bc32-ede61e5763b2', 'volume_name': 'volume-d75429fa-5ad6-44be-bc32-ede61e5763b2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62be82c2-5272-424d-98e6-2e54757a92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62be82c2-5272-424d-98e6-2e54757a92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6e7bfc-4567-417c-a93c-d6a29ca34acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Volume d75429fa-5ad6-44be-bc32-ede61e5763b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75429fa-5ad6-44be-bc32-ede61e5763b2', 'volume_size': 1} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (cf0dc9bc-c5a0-4f2f-9d1d-7875d15b538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188793e9-847b-40c8-a47a-f9ecaba1d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188793e9-847b-40c8-a47a-f9ecaba1d073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373205659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa245fa-ad91-45de-8915-6aab94fef44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:36Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb525ac-13b2-43b9-ace2-d71122d3410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb525ac-13b2-43b9-ace2-d71122d3410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339d1cba-82bb-4c95-af2e-28a31658e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339d1cba-82bb-4c95-af2e-28a31658e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa245fa-ad91-45de-8915-6aab94fef44c', 'volume_name': 'volume-3aa245fa-ad91-45de-8915-6aab94fef44c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7768aa26-7f1b-4512-a96f-441efb801c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7768aa26-7f1b-4512-a96f-441efb801c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e576eee-e148-4107-ad21-b978c6be54ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Volume 3aa245fa-ad91-45de-8915-6aab94fef44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa245fa-ad91-45de-8915-6aab94fef44c', 'volume_size': 1} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (5a96cfa9-cbaf-402c-bd0d-9679796ae745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ed10b4-d5ba-46aa-8243-8db4704f85f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ed10b4-d5ba-46aa-8243-8db4704f85f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951490309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:36Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f913f80b-98bf-41e4-b25d-fe9ab7abf54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f913f80b-98bf-41e4-b25d-fe9ab7abf54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f48fc-ae31-42e0-ad6c-c9f5831f6708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f48fc-ae31-42e0-ad6c-c9f5831f6708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7', 'volume_name': 'volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d3b456-4500-4482-8296-3095b4f1a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d3b456-4500-4482-8296-3095b4f1a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92060885-30d4-4250-8266-dea1fcfb5ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Volume aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7', 'volume_size': 1} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:36 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 1073741824" returned: 0 in 1.253s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:36 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 Jul 11 18:16:36 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (31483593-e7b4-4a96-afa1-7280e62f59d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4dd18-e919-4143-9d7c-b96048e989f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4dd18-e919-4143-9d7c-b96048e989f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292361404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f100ec-a3e7-43d9-9399-d9ff87da7566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:37Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c10114e-6222-43dc-9f32-12641eed0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c10114e-6222-43dc-9f32-12641eed0813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4611edc7-250b-4b41-90fd-846cdde27846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4611edc7-250b-4b41-90fd-846cdde27846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f100ec-a3e7-43d9-9399-d9ff87da7566', 'volume_name': 'volume-36f100ec-a3e7-43d9-9399-d9ff87da7566', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d03ae7-b34a-46df-9a24-26261aa28e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d03ae7-b34a-46df-9a24-26261aa28e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e540b714-cdec-454e-99a7-8e03b777dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:36 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Volume 36f100ec-a3e7-43d9-9399-d9ff87da7566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f100ec-a3e7-43d9-9399-d9ff87da7566', 'volume_size': 1} Jul 11 18:16:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (f964d486-0d3c-4d61-98c7-fd73a7792b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0516562-a0b7-4ad6-b9e9-4f7d8a2a9fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0516562-a0b7-4ad6-b9e9-4f7d8a2a9fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-177430482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9136267-93eb-4765-8737-2e06b944130e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:37Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897de2ec-ce37-4c71-9449-2181cbed7cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897de2ec-ce37-4c71-9449-2181cbed7cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352533fb-ff80-45cb-af98-a06b0ba4bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352533fb-ff80-45cb-af98-a06b0ba4bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9136267-93eb-4765-8737-2e06b944130e', 'volume_name': 'volume-e9136267-93eb-4765-8737-2e06b944130e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cb1bcb-de5f-41bf-a336-c114b79f49e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cb1bcb-de5f-41bf-a336-c114b79f49e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ded03d-1a8a-4e06-bd03-db5897579486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Volume e9136267-93eb-4765-8737-2e06b944130e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9136267-93eb-4765-8737-2e06b944130e', 'volume_size': 1} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:37 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" returned: 0 in 0.918s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-539485829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75429fa-5ad6-44be-bc32-ede61e5763b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:35Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Creating volume d75429fa-5ad6-44be-bc32-ede61e5763b2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:37 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55d2806-9f0f-484f-9ad9-353506db7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 1073741824 Jul 11 18:16:37 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bc4633-1d2a-4b3f-97ab-82b888e6d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:37 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 (7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9): created successfully Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bc4633-1d2a-4b3f-97ab-82b888e6d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:37 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (e0eb84a2-13c8-4c93-ae78-028bd0b9b321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d58f1594-9a0b-4ee2-9b2f-b782eb1b888d tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:16:38 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 1073741824" returned: 0 in 1.011s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:38 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 Jul 11 18:16:38 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Flow 'volume_create_manager' (667aba8c-dd22-41ff-9603-27e6adc47eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0557b041-839f-4d29-a772-1bbe776b74cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0557b041-839f-4d29-a772-1bbe776b74cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeb0af6-dcaa-49f4-98df-4b46f32b25d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8372d190a246c6b915c6053121bc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:39Z,use_quota=True,user_id='b31880e0e34a43669645efa8fcce2744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2467575d-7122-4e71-84a7-fff38d451346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2467575d-7122-4e71-84a7-fff38d451346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d059c-7390-408d-addb-2889207d98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:38 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d059c-7390-408d-addb-2889207d98fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edeb0af6-dcaa-49f4-98df-4b46f32b25d1', 'volume_name': 'volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1', 'volume_size': 1, 'image_id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3353d2f72f0f2bbdfa2d4322b65ac7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8372d190a246c6b915c6053121bc34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b7aa9327dcfd5615d7df77fe5744ded5b0319fddfc1afc832ee73311852073a8b1125fa2368c1b970057170fed235380ea368e77c526cbe406388572a2e240b', 'id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee131960-e677-4634-8b8b-cd25d89de4db/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92811b1d-01fa-4adc-b5a8-443164434a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92811b1d-01fa-4adc-b5a8-443164434a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61e3eae-e52d-4d43-85e7-c62d53488a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1', 'volume_size': 1, 'image_id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3353d2f72f0f2bbdfa2d4322b65ac7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8372d190a246c6b915c6053121bc34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b7aa9327dcfd5615d7df77fe5744ded5b0319fddfc1afc832ee73311852073a8b1125fa2368c1b970057170fed235380ea368e77c526cbe406388572a2e240b', 'id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee131960-e677-4634-8b8b-cd25d89de4db/file', 'properties': {}}, 'image_service': } Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Trying to clone edeb0af6-dcaa-49f4-98df-4b46f32b25d1 from image ee131960-e677-4634-8b8b-cd25d89de4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:16:39 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2" returned: 0 in 0.699s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373205659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa245fa-ad91-45de-8915-6aab94fef44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:36Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Creating volume 3aa245fa-ad91-45de-8915-6aab94fef44c {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6e7bfc-4567-417c-a93c-d6a29ca34acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75429fa-5ad6-44be-bc32-ede61e5763b2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c 1073741824 Jul 11 18:16:39 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bd1c95-68e7-40ea-b784-49f6d2d0375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Volume volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 (d75429fa-5ad6-44be-bc32-ede61e5763b2): created successfully Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bd1c95-68e7-40ea-b784-49f6d2d0375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (bf32eaa4-106b-4242-8549-4effe2522823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-cdf7112d-5ac0-4687-b6e3-e12ed72b6ce3 tempest-CreateVolumesFromImageTest-474155981 None] Created volume successfully. Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee09902-a383-46e6-8c7b-3598774d9374]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:39 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:39 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Flow 'volume_create_manager' (dc60652a-5330-4e73-b149-c122f1e2afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77bc27a-6f34-4edf-9b98-f44b5ab2d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77bc27a-6f34-4edf-9b98-f44b5ab2d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12795a7359134b47b4b435200ec60300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:40Z,use_quota=True,user_id='44158f3396644c65ab5dc3fa7e2e13a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b9fb62-890b-4084-9a2f-70e2c9531d43),volume_type_id=70b9fb62-890b-4084-9a2f-70e2c9531d43)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a985373-d4b5-4391-b26c-8e85c76bbf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a985373-d4b5-4391-b26c-8e85c76bbf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458402b-e5d2-4a5e-9de1-7b2b6a106a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.image.glance [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Creating Keystone auth plugin from conf {{(pid=86932) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458402b-e5d2-4a5e-9de1-7b2b6a106a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac', 'volume_name': 'volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac', 'volume_size': 1, 'image_id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cf458a23d82d506e395b1bcf98b1cbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12795a7359134b47b4b435200ec60300', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '003e484c4e31e9ea22ef416b01328bee196ada30504bff291d8eae3c005aeeecb91130f6809d864c87b123480a8b84c65cab9d33e254ef3dec42cb31501e9543', 'id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26cfc848-88df-42bf-ab03-ec54eabe4cea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac3a9c7-a59b-4111-82c4-f88200f0787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac3a9c7-a59b-4111-82c4-f88200f0787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37ecb14-b6b3-4723-84a8-4c0c5d957add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:39 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac', 'volume_size': 1, 'image_id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cf458a23d82d506e395b1bcf98b1cbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12795a7359134b47b4b435200ec60300', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '003e484c4e31e9ea22ef416b01328bee196ada30504bff291d8eae3c005aeeecb91130f6809d864c87b123480a8b84c65cab9d33e254ef3dec42cb31501e9543', 'id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26cfc848-88df-42bf-ab03-ec54eabe4cea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 18:16:39 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Trying to clone e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac from image 26cfc848-88df-42bf-ab03-ec54eabe4cea at location (None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}]). {{(pid=86932) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:16:40 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee064f8-05b7-4d04-9c54-528ed998c5c9]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:40 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:40 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c 1073741824" returned: 0 in 0.967s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 0 in 0.873s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:40 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:40 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:40 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c Jul 11 18:16:40 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:40 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:40 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:40 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:41 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:41 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 1 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Temporary image ee131960-e677-4634-8b8b-cd25d89de4db is fetched for user b31880e0e34a43669645efa8fcce2744. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.562s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951490309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:36Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Creating volume aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:41 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:41 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:41 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:41 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 1073741824 Jul 11 18:16:41 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e576eee-e148-4107-ad21-b978c6be54ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa245fa-ad91-45de-8915-6aab94fef44c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4002e786-0b67-4f52-90ba-f62394223dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Volume volume-3aa245fa-ad91-45de-8915-6aab94fef44c (3aa245fa-ad91-45de-8915-6aab94fef44c): created successfully Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4002e786-0b67-4f52-90ba-f62394223dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (cf0dc9bc-c5a0-4f2f-9d1d-7875d15b538c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cfaa1e-f6c9-44df-970b-fb1f469a9e56]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-51b46824-c53f-45c4-8480-d3e76a3feb41 tempest-CreateVolumesFromImageTest-474155981 None] Created volume successfully. Jul 11 18:16:41 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:41 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:41 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 1 in 0.786s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Temporary image 26cfc848-88df-42bf-ab03-ec54eabe4cea is fetched for user 44158f3396644c65ab5dc3fa7e2e13a0. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b951e15f-1b00-4676-bd1a-475ed1c61fba]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:41 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:41 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:41 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:41 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 1073741824" returned: 0 in 0.905s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:42 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 Jul 11 18:16:42 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:42 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:42 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:42 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:42 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:42 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" returned: 0 in 0.654s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 1 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeb0af6-dcaa-49f4-98df-4b46f32b25d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8372d190a246c6b915c6053121bc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:39Z,use_quota=True,user_id='b31880e0e34a43669645efa8fcce2744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Creating volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:42 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:42 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1073741824 Jul 11 18:16:42 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92060885-30d4-4250-8266-dea1fcfb5ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e6a20e-951d-4bf5-b377-770c8b2d05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:42 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:42 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:42 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Volume volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 (aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7): created successfully Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e6a20e-951d-4bf5-b377-770c8b2d05a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:42 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (5a96cfa9-cbaf-402c-bd0d-9679796ae745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2c52ddab-34ea-49c3-8af9-15535ec65758 tempest-CreateVolumesFromImageTest-474155981 None] Created volume successfully. Jul 11 18:16:43 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:43 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1073741824" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:43 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:43 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:44 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 0 in 0.639s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.772s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-177430482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9136267-93eb-4765-8737-2e06b944130e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:37Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Creating volume e9136267-93eb-4765-8737-2e06b944130e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:44 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:44 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e 1073741824 Jul 11 18:16:44 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Attempting download of ee131960-e677-4634-8b8b-cd25d89de4db ((None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}])) to volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c959b0-0cea-4682-9c51-4e4c1662386c]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:44 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6 Jul 11 18:16:44 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:45 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e 1073741824" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:45 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6" returned: 0 in 0.779s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:45 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e Jul 11 18:16:45 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:45 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6 Jul 11 18:16:45 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:45 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.034s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:45 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ded03d-1a8a-4e06-bd03-db5897579486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9136267-93eb-4765-8737-2e06b944130e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5635c251-eab8-4aec-9cfd-1f7365ee9fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6" returned: 1 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee131960-e677-4634-8b8b-cd25d89de4db_srbzgzb6' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating offline snapshot c2f796f8-eeeb-4619-a9d7-b3472ea29f61 of volume 7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c86aa-2cee-4ba3-8e4c-3baf4e5da3cb]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1a2d8-041d-47f4-a193-226233835c40]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:45 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Volume volume-e9136267-93eb-4765-8737-2e06b944130e (e9136267-93eb-4765-8737-2e06b944130e): created successfully Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5635c251-eab8-4aec-9cfd-1f7365ee9fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (f964d486-0d3c-4d61-98c7-fd73a7792b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d9199d6a-f36c-4322-95be-06e7f410bc4c tempest-CreateVolumesFromImageTest-474155981 None] Created volume successfully. Jul 11 18:16:45 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:45 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:45 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 Jul 11 18:16:45 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:46 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:46 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:46 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 1G Jul 11 18:16:46 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:46 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD Jul 11 18:16:46 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:47 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD" returned: 1 in 0.751s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] ee131960-e677-4634-8b8b-cd25d89de4db was raw, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:47 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:47 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:47 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 1G" returned: 0 in 0.871s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:47 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 Jul 11 18:16:47 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:48 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 0 in 0.791s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee131960-e677-4634-8b8b-cd25d89de4db_knbqzbs2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:16:48 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:48 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1G Jul 11 18:16:48 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:48 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61" returned: 0 in 0.714s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:48 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 is being set with open permissions: ugo+rw Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:48 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 Jul 11 18:16:48 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:48 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 1G" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df66e93-00d8-4076-bed7-43fe645c3003]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:48 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:48 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info Jul 11 18:16:48 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:48 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:48 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:49 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:49 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info is being set with open permissions: ugo+rw Jul 11 18:16:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:49 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info Jul 11 18:16:49 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:49 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 0 in 0.781s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:49 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:49 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:50 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.info" returned: 0 in 0.622s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.426s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.235s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292361404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f100ec-a3e7-43d9-9399-d9ff87da7566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409beb8081d4d7da96c138ffde899a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:37Z,use_quota=True,user_id='0ed8a3a5537648ea97c2d8741164bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Creating volume 36f100ec-a3e7-43d9-9399-d9ff87da7566 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:50 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:50 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 1073741824 Jul 11 18:16:50 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c90a56af-f09f-4ddc-8e80-5cb3ed6851d3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Create snapshot completed successfully Jul 11 18:16:50 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 1 in 0.752s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Downloaded image ee131960-e677-4634-8b8b-cd25d89de4db ((None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}])) to volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1 successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Temporary image ee131960-e677-4634-8b8b-cd25d89de4db for user b31880e0e34a43669645efa8fcce2744 is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Marking volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1 as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Copying metadata from image ee131960-e677-4634-8b8b-cd25d89de4db to edeb0af6-dcaa-49f4-98df-4b46f32b25d1. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Creating volume glance metadata for volume edeb0af6-dcaa-49f4-98df-4b46f32b25d1 backed by image ee131960-e677-4634-8b8b-cd25d89de4db with: {'image_id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8f3353d2f72f0f2bbdfa2d4322b65ac7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61e3eae-e52d-4d43-85e7-c62d53488a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1', 'volume_size': 1, 'image_id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee131960-e677-4634-8b8b-cd25d89de4db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3353d2f72f0f2bbdfa2d4322b65ac7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8372d190a246c6b915c6053121bc34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b7aa9327dcfd5615d7df77fe5744ded5b0319fddfc1afc832ee73311852073a8b1125fa2368c1b970057170fed235380ea368e77c526cbe406388572a2e240b', 'id': 'ee131960-e677-4634-8b8b-cd25d89de4db', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee131960-e677-4634-8b8b-cd25d89de4db/file', 'properties': {}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ec06b-a7d1-40d7-b934-84b07819de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:50 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Volume volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 (edeb0af6-dcaa-49f4-98df-4b46f32b25d1): created successfully Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ec06b-a7d1-40d7-b934-84b07819de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:50 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Flow 'volume_create_manager' (667aba8c-dd22-41ff-9603-27e6adc47eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:50 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-52c753a8-c4d0-46b5-8e36-b88eea5c2c99 tempest-VolumeImageDependencyTests-1973554264 None] Created volume successfully. Jul 11 18:16:51 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 1073741824" returned: 0 in 0.793s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:51 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 Jul 11 18:16:51 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (7bcd3e90-0f5b-4706-992b-c6d33b00628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f10dd-2f58-4117-88c0-456f5b29827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f10dd-2f58-4117-88c0-456f5b29827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375418632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5f057f-2d98-4636-ac7d-25d8b7567d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:51Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3480c81-5795-4530-b020-ec1b01850136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3480c81-5795-4530-b020-ec1b01850136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11512cce-ac8b-48af-9b00-05fd88eb74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11512cce-ac8b-48af-9b00-05fd88eb74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5f057f-2d98-4636-ac7d-25d8b7567d22', 'volume_name': 'volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc4d2d0-6763-4ea6-875c-4a90c32bc572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc4d2d0-6763-4ea6-875c-4a90c32bc572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f807e1ca-1a4c-4b60-9d9d-51ee58237823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume 4e5f057f-2d98-4636-ac7d-25d8b7567d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22', 'volume_size': 1} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Acquiring lock "cinder-edeb0af6-dcaa-49f4-98df-4b46f32b25d1-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "cinder-edeb0af6-dcaa-49f4-98df-4b46f32b25d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Acquiring lock "cinder-quobyte-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "cinder-quobyte-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[729dc5cb-4853-4741-a9ac-5cc44fba78f8]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:51 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566" returned: 0 in 0.708s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.403s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12795a7359134b47b4b435200ec60300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:40Z,use_quota=True,user_id='44158f3396644c65ab5dc3fa7e2e13a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b9fb62-890b-4084-9a2f-70e2c9531d43),volume_type_id=70b9fb62-890b-4084-9a2f-70e2c9531d43)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Creating volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:51 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e540b714-cdec-454e-99a7-8e03b777dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f100ec-a3e7-43d9-9399-d9ff87da7566', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1073741824 Jul 11 18:16:51 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455b531-e7c8-4a95-9128-e220dc130c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Volume volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 (36f100ec-a3e7-43d9-9399-d9ff87da7566): created successfully Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455b531-e7c8-4a95-9128-e220dc130c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Flow 'volume_create_manager' (31483593-e7b4-4a96-afa1-7280e62f59d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-eb817015-5e87-42ab-94ab-7d312bf8b5c1 tempest-CreateVolumesFromImageTest-474155981 None] Created volume successfully. Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (40ef796d-7c14-478e-8739-430defc538c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:51 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:51 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee898f2-8083-4a22-944c-9b08ea57e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee898f2-8083-4a22-944c-9b08ea57e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797886579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed19448-8c92-4e6e-954e-98a33d2b24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:52Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb0854a-c6d1-4dda-a00d-64080cf21272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb0854a-c6d1-4dda-a00d-64080cf21272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9191bbd-5b12-4c9a-bdc1-6ca33d01f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9191bbd-5b12-4c9a-bdc1-6ca33d01f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed19448-8c92-4e6e-954e-98a33d2b24c0', 'volume_name': 'volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53acc6-bc1d-4f10-966b-51229c64f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53acc6-bc1d-4f10-966b-51229c64f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50759953-bd00-4102-b1c2-06ac909b33a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:51 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume 5ed19448-8c92-4e6e-954e-98a33d2b24c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0', 'volume_size': 1} Jul 11 18:16:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (fbb28c55-81d3-4977-a035-1d23c0949f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde2b2f3-c33b-4d68-b94c-89f738029e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde2b2f3-c33b-4d68-b94c-89f738029e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789129002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12da96a-2da9-47e0-b5fc-6a772dc314b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:52Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c2d81b-a9ee-49dd-8ece-8ab012614f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c2d81b-a9ee-49dd-8ece-8ab012614f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2e95b-7e13-47b7-98ee-69cdc34e615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2e95b-7e13-47b7-98ee-69cdc34e615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12da96a-2da9-47e0-b5fc-6a772dc314b4', 'volume_name': 'volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab191b-e012-41a3-83bc-70449b9452d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab191b-e012-41a3-83bc-70449b9452d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737b7447-04f6-4c03-b2bf-305462c4b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume c12da96a-2da9-47e0-b5fc-6a772dc314b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4', 'volume_size': 1} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (36e9bb04-d697-4605-b009-fb44887f733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cbfaff-e88f-4ada-b675-8a606eaa68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cbfaff-e88f-4ada-b675-8a606eaa68a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706128670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd67c583-1dda-4be4-9cd8-dc1791d11e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:53Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892014cb-02a0-4567-8b6e-954e38b5bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892014cb-02a0-4567-8b6e-954e38b5bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2752547-5af7-4c21-8461-fc5169133c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2752547-5af7-4c21-8461-fc5169133c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd67c583-1dda-4be4-9cd8-dc1791d11e2a', 'volume_name': 'volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df29ad23-1c0b-4f2a-ab37-b34346d3aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df29ad23-1c0b-4f2a-ab37-b34346d3aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa76351-8ae8-424c-8b8b-333c0102c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:52 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume cd67c583-1dda-4be4-9cd8-dc1791d11e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a', 'volume_size': 1} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-e9136267-93eb-4765-8737-2e06b944130e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-e9136267-93eb-4765-8737-2e06b944130e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:52 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 0 in 1.102s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-quobyte-e9136267-93eb-4765-8737-2e06b944130e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-e9136267-93eb-4765-8737-2e06b944130e" acquired by "delete_volume" :: waited 0.043s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[578b7adc-d6e7-4f0a-9bbb-598cad478fa0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:53 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:53 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1073741824" returned: 0 in 1.302s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:53 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e Jul 11 18:16:53 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:53 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:16:53 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (7f8208ad-b021-4c4e-9f94-835780232493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2a4d5-b69b-4c32-b62f-5f51044fad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2a4d5-b69b-4c32-b62f-5f51044fad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101339853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ff076-f61c-4eb7-abad-109c71eca729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:53Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeb9881-e50e-477c-a477-1ddb262c223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeb9881-e50e-477c-a477-1ddb262c223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c62e90-293a-4d87-a05d-688686e33fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c62e90-293a-4d87-a05d-688686e33fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234ff076-f61c-4eb7-abad-109c71eca729', 'volume_name': 'volume-234ff076-f61c-4eb7-abad-109c71eca729', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d618548-6cc9-4977-91ff-9488316b5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d618548-6cc9-4977-91ff-9488316b5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c682b1-2668-4882-ad16-980599882074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:53 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume 234ff076-f61c-4eb7-abad-109c71eca729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234ff076-f61c-4eb7-abad-109c71eca729', 'volume_size': 1} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:53 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:53 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:53 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 1 in 0.964s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 0 in 0.690s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.274s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375418632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5f057f-2d98-4636-ac7d-25d8b7567d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:51Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume 4e5f057f-2d98-4636-ac7d-25d8b7567d22 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:53 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1 Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:53 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:53 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e" returned: 0 in 0.873s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:53 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 1073741824 Jul 11 18:16:53 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Attempting download of 26cfc848-88df-42bf-ab03-ec54eabe4cea ((None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}])) to volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:16:53 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e Jul 11 18:16:53 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac32f1-fc3d-4d59-b963-8e8f48a706cf]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:54 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g Jul 11 18:16:54 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:54 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" returned: 0 in 0.717s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "cinder-quobyte-edeb0af6-dcaa-49f4-98df-4b46f32b25d1" released by "delete_volume" :: held 2.864s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Created reservations ['b6ca9d9e-98a3-43b7-a96a-934c37084884', '63059acf-9393-4909-a743-736879c8a417', '744316f9-3ad4-4af6-a700-5699480242dc', '15276b75-abf2-4f68-a596-f46d70cb1e05'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:54 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e9136267-93eb-4765-8737-2e06b944130e" returned: 0 in 0.759s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-e9136267-93eb-4765-8737-2e06b944130e" released by "delete_volume" :: held 1.684s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Created reservations ['5386bbed-4810-4fbd-8ae7-d5ba13b9f4b8', '155da7dc-576b-4789-a5f2-0bf263bc603b', 'ee63fbf6-f198-4121-a961-01c01ff4cc3d', '695409b2-6c3a-4654-bee6-ddc0474af370'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:54 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:54 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:54 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:54 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 1073741824" returned: 0 in 1.045s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g" returned: 0 in 0.920s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:54 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:54 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:54 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 Jul 11 18:16:54 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:55 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g Jul 11 18:16:55 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-36f100ec-a3e7-43d9-9399-d9ff87da7566-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-36f100ec-a3e7-43d9-9399-d9ff87da7566-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-quobyte-36f100ec-a3e7-43d9-9399-d9ff87da7566" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-36f100ec-a3e7-43d9-9399-d9ff87da7566" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e6394e-a4c6-4f1d-b033-3f9b47253567]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:55 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 Jul 11 18:16:55 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:55 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.139s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Deleted volume successfully. Jul 11 18:16:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-735b2319-a999-4ab0-b921-208b4fcff78f tempest-VolumeImageDependencyTests-1973554264 None] Lock "cinder-edeb0af6-dcaa-49f4-98df-4b46f32b25d1-delete_volume" released by "delete_volume" :: held 4.337s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:56 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.187s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Deleted volume successfully. Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfeafe84-6884-44e7-be85-7d44c12f8361 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-e9136267-93eb-4765-8737-2e06b944130e-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:56 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22" returned: 0 in 1.182s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.173s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797886579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed19448-8c92-4e6e-954e-98a33d2b24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:52Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume 5ed19448-8c92-4e6e-954e-98a33d2b24c0 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:56 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:56 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g" returned: 1 in 1.277s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26cfc848-88df-42bf-ab03-ec54eabe4cea_ph2vu__g' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ed3f7-20c5-45ef-b90f-d48d3d9e1cd7]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:56 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 1073741824 Jul 11 18:16:56 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f807e1ca-1a4c-4b60-9d9d-51ee58237823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d851a08-582d-4612-8415-f7ef3b17c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:56 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 (4e5f057f-2d98-4636-ac7d-25d8b7567d22): created successfully Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d851a08-582d-4612-8415-f7ef3b17c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (7bcd3e90-0f5b-4706-992b-c6d33b00628c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-15c3b605-e672-4845-8b84-c7af6037fcbd tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:16:56 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566" returned: 0 in 0.922s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:56 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:56 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:56 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566 Jul 11 18:16:56 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:57 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-36f100ec-a3e7-43d9-9399-d9ff87da7566" returned: 0 in 0.835s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:57 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:57 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-36f100ec-a3e7-43d9-9399-d9ff87da7566" released by "delete_volume" :: held 1.817s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 1073741824" returned: 0 in 0.998s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:57 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 Jul 11 18:16:57 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Created reservations ['03c78ace-ba9f-42dd-840e-9827dc07f7c9', 'dfcde09e-f424-42bb-a581-ab72f8b13a7e', '61717e04-023c-47fe-84c4-889e43eeab6e', '4d032ad7-a745-4b35-ae34-d8963354b33e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:57 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD Jul 11 18:16:57 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:57 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:57 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-quobyte-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[306acce0-2bda-4cc3-9cd0-c99418365611]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:16:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:58 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 Jul 11 18:16:58 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:58 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0" returned: 0 in 0.882s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.717s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789129002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12da96a-2da9-47e0-b5fc-6a772dc314b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:52Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume c12da96a-2da9-47e0-b5fc-6a772dc314b4 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:16:58 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50759953-bd00-4102-b1c2-06ac909b33a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8fddd6-4008-425e-8df7-e1f737af2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:16:58 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 1073741824 Jul 11 18:16:58 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:58 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 (5ed19448-8c92-4e6e-954e-98a33d2b24c0): created successfully Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8fddd6-4008-425e-8df7-e1f737af2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (40ef796d-7c14-478e-8739-430defc538c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:16:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-14239ff8-b130-435a-a217-c9beb314b33f tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:16:58 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD" returned: 1 in 1.093s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] 26cfc848-88df-42bf-ab03-ec54eabe4cea was raw, converting to raw {{(pid=86932) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:58 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:16:58 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:58 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.031s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:16:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Deleted volume successfully. Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f87c86c2-5c34-40aa-ba00-bed2b4b0077e tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-36f100ec-a3e7-43d9-9399-d9ff87da7566-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:58 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" returned: 0 in 1.018s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:58 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7 Jul 11 18:16:58 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:59 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 0 in 0.931s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26cfc848-88df-42bf-ab03-ec54eabe4cea_v_q7btbndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:16:59 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:59 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 1073741824" returned: 0 in 1.085s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:59 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1G Jul 11 18:16:59 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:59 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 Jul 11 18:16:59 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:59 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" returned: 0 in 0.747s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7" released by "delete_volume" :: held 1.831s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Created reservations ['e8c683db-f788-442f-bb7b-7ab59b239059', 'a80534e1-27ce-44b8-a425-56fb28f660da', '345e730f-3337-4206-9d0e-fe9160cac4f3', '3e123adc-9bcc-4e92-849b-71aebc039fd6'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:16:59 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:16:59 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:16:59 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac 1G" returned: 0 in 0.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:59 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4" returned: 0 in 0.745s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.212s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706128670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd67c583-1dda-4be4-9cd8-dc1791d11e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:53Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume cd67c583-1dda-4be4-9cd8-dc1791d11e2a {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:16:59 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:00 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[45797c46-825f-4764-9707-02a527d6f639]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-3aa245fa-ad91-45de-8915-6aab94fef44c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:00 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a 1073741824 Jul 11 18:17:00 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737b7447-04f6-4c03-b2bf-305462c4b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698d1d8-5fe0-416c-9b9a-13604462de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-3aa245fa-ad91-45de-8915-6aab94fef44c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:00 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 (c12da96a-2da9-47e0-b5fc-6a772dc314b4): created successfully Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698d1d8-5fe0-416c-9b9a-13604462de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (fbb28c55-81d3-4977-a035-1d23c0949f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-374bd53d-499c-45ea-a292-aa33ec4386d0 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-quobyte-3aa245fa-ad91-45de-8915-6aab94fef44c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-3aa245fa-ad91-45de-8915-6aab94fef44c" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:00 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:17:00 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bae3d74-8721-4628-86d6-840918f13b56]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:00 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c Jul 11 18:17:00 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-b1e369e2-ddbe-4d77-87da-af042c9ded2a tempest-ProjectAdminTests-1486388624 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86932) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 18:17:00 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:00 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Deleted volume successfully. Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-75d54600-864f-4424-9afe-a3190164d3c9 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-aa66c8c0-caf3-49ae-9ae7-7e9325b6a5d7-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:00 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a 1073741824" returned: 0 in 0.929s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:00 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 0 in 0.934s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:01 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a Jul 11 18:17:01 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:01 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:17:01 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:01 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c" returned: 0 in 1.001s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:01 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c Jul 11 18:17:01 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:01 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" returned: 0 in 0.759s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.463s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101339853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ff076-f61c-4eb7-abad-109c71eca729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46034d09df407cbefb6277870ef8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:16:53Z,use_quota=True,user_id='eb386e4f5c954a20a5bb1ce4748dd56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Creating volume 234ff076-f61c-4eb7-abad-109c71eca729 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:01 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:01 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa76351-8ae8-424c-8b8b-333c0102c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:01 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 1073741824 Jul 11 18:17:01 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c4d6fe-455e-4bf2-87f2-6c5e2f7bba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 1 in 0.868s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Downloaded image 26cfc848-88df-42bf-ab03-ec54eabe4cea ((None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}])) to volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac successfully. {{(pid=86932) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Temporary image 26cfc848-88df-42bf-ab03-ec54eabe4cea for user 44158f3396644c65ab5dc3fa7e2e13a0 is deleted. {{(pid=86932) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.volume_utils [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Marking volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac as bootable. {{(pid=86932) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:17:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a (cd67c583-1dda-4be4-9cd8-dc1791d11e2a): created successfully Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c4d6fe-455e-4bf2-87f2-6c5e2f7bba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (36e9bb04-d697-4605-b009-fb44887f733b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Copying metadata from image 26cfc848-88df-42bf-ab03-ec54eabe4cea to e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac. {{(pid=86932) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Creating volume glance metadata for volume e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac backed by image 26cfc848-88df-42bf-ab03-ec54eabe4cea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0cf458a23d82d506e395b1bcf98b1cbe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86932) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:17:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-cdf4c1a0-93d4-4c09-b762-e6f27396ad95 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37ecb14-b6b3-4723-84a8-4c0c5d957add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac', 'volume_size': 1, 'image_id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26cfc848-88df-42bf-ab03-ec54eabe4cea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cf458a23d82d506e395b1bcf98b1cbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12795a7359134b47b4b435200ec60300', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '003e484c4e31e9ea22ef416b01328bee196ada30504bff291d8eae3c005aeeecb91130f6809d864c87b123480a8b84c65cab9d33e254ef3dec42cb31501e9543', 'id': '26cfc848-88df-42bf-ab03-ec54eabe4cea', 'created_at': datetime.datetime(2026, 7, 11, 16, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26cfc848-88df-42bf-ab03-ec54eabe4cea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db713941-80f5-4715-a172-f3a11b00b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:02 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Volume volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac (e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac): created successfully Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db713941-80f5-4715-a172-f3a11b00b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Flow 'volume_create_manager' (dc60652a-5330-4e73-b149-c122f1e2afce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:02 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-740512b9-e2d4-4acf-8173-ec33b2e33977 tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Created volume successfully. Jul 11 18:17:02 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3aa245fa-ad91-45de-8915-6aab94fef44c" returned: 0 in 0.854s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-3aa245fa-ad91-45de-8915-6aab94fef44c" released by "delete_volume" :: held 1.908s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Created reservations ['e0bda3a1-2147-4d6c-ba9a-7158e522d93e', '83c51eca-54b9-40fb-8369-44ddd063e739', '309c48fd-5ce7-4f62-8b07-d68edc1a78d9', 'a9927857-99fa-4d28-ad15-d2e3f36619a8'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:02 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:02 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Acquiring lock "cinder-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "cinder-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-d75429fa-5ad6-44be-bc32-ede61e5763b2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-d75429fa-5ad6-44be-bc32-ede61e5763b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Acquiring lock "cinder-quobyte-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "cinder-quobyte-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" acquired by "delete_volume" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "cinder-quobyte-d75429fa-5ad6-44be-bc32-ede61e5763b2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-d75429fa-5ad6-44be-bc32-ede61e5763b2" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[871997da-49da-4d3f-a0b2-d820c8d9050e]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[50643e8d-e2c0-4e9d-8c90-23d83af49fa3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:02 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:17:02 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:02 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 Jul 11 18:17:02 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:03 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 1073741824" returned: 0 in 1.234s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:03 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 Jul 11 18:17:03 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:03 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.044s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Deleted volume successfully. Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-daf0dfb0-9f19-4d99-8dd7-e1dc5a0f69ef tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-3aa245fa-ad91-45de-8915-6aab94fef44c-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:03 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 0 in 1.033s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:03 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2" returned: 0 in 1.137s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:03 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:17:03 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:03 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2 Jul 11 18:17:03 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:04 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729" returned: 0 in 0.935s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c682b1-2668-4882-ad16-980599882074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234ff076-f61c-4eb7-abad-109c71eca729', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b2bca3-c3eb-4700-afe6-42eba49f1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=101,cinder:UPDATE=128,cinder:INSERT=37,cinder:DELETE=15 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:17:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Volume volume-234ff076-f61c-4eb7-abad-109c71eca729 (234ff076-f61c-4eb7-abad-109c71eca729): created successfully Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b2bca3-c3eb-4700-afe6-42eba49f1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Flow 'volume_create_manager' (7f8208ad-b021-4c4e-9f94-835780232493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:04 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-98201300-a7f1-4c63-b219-a461b1799b4b tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created volume successfully. Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-234ff076-f61c-4eb7-abad-109c71eca729-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-234ff076-f61c-4eb7-abad-109c71eca729-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:04 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 1 in 0.901s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac' failed. Not Retrying. {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:04 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac Jul 11 18:17:04 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-234ff076-f61c-4eb7-abad-109c71eca729" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-234ff076-f61c-4eb7-abad-109c71eca729" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd91f20-da68-4876-95f9-a45b041b4cb7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:04 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d75429fa-5ad6-44be-bc32-ede61e5763b2" returned: 0 in 0.925s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-quobyte-d75429fa-5ad6-44be-bc32-ede61e5763b2" released by "delete_volume" :: held 2.122s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Created reservations ['0f4800a8-0425-4bd6-8cc2-c77f67ffaa6c', 'a92dd5f7-fb0b-46d4-9d86-42e5cbdb5b00', '3b1607a3-1def-423d-a378-fc377aa3fc9f', '7d397d84-8aa2-4445-a27d-1a7f61c35d0b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:04 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 Jul 11 18:17:04 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:04 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:04 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:05 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "cinder-quobyte-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac" released by "delete_volume" :: held 2.807s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Created reservations ['0a33cc63-6c5b-420c-ab94-0b2335f9b9b1', 'f347a930-8f57-4b14-b58b-7331da35f5ab', '8dac5802-b201-4408-8d65-15266b766c5e', '2beda963-6f02-412b-a1d1-1d63bb5cad08'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (c5a0877f-ed9a-43f8-9b17-3b3842af2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14580a1d-7eb7-47a5-a99e-5716d3cfecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:05 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:05 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14580a1d-7eb7-47a5-a99e-5716d3cfecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310116637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e8215e-dc2d-4b20-8200-c422402aacee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:05Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b5cf9-7adf-499c-a9ed-43f313719f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b5cf9-7adf-499c-a9ed-43f313719f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a76615-1780-4757-9e3d-3d4208d1b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a76615-1780-4757-9e3d-3d4208d1b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e8215e-dc2d-4b20-8200-c422402aacee', 'volume_name': 'volume-60e8215e-dc2d-4b20-8200-c422402aacee', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b906385-1dea-4e74-9e79-6408d6806c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b906385-1dea-4e74-9e79-6408d6806c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96122d1d-d532-4adc-b1d4-5304fd8349f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:05 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Volume 60e8215e-dc2d-4b20-8200-c422402aacee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e8215e-dc2d-4b20-8200-c422402aacee', 'volume_size': 1} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310116637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e8215e-dc2d-4b20-8200-c422402aacee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:05Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Creating volume 60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:05 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:05 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729" returned: 0 in 1.019s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:05 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee 1073741824 Jul 11 18:17:05 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:05 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729 Jul 11 18:17:05 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:05 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.079s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Deleted volume successfully. Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-aaa2c2f7-6560-4205-b69e-9175058709f6 tempest-CreateVolumesFromImageTest-474155981 None] Lock "cinder-d75429fa-5ad6-44be-bc32-ede61e5763b2-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:06 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-234ff076-f61c-4eb7-abad-109c71eca729" returned: 0 in 0.880s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-234ff076-f61c-4eb7-abad-109c71eca729" released by "delete_volume" :: held 1.966s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:06 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.118s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Deleted volume successfully. Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['1b0f2fac-6c86-4428-b28a-2115ded86162', 'b840e01a-b017-4d87-b586-dd29a46323aa', 'd148d37b-3e80-4e98-8986-14da877f8891', 'd216c59f-78be-4f8f-8904-5784c8bfdadc'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8238139b-d73e-434c-9899-d02f6e0ef0fa tempest-VolumeAndVolumeTypeFromImageTest-520846689 None] Lock "cinder-e4369cb5-0a8c-4f18-b30d-b53bb1cae0ac-delete_volume" released by "delete_volume" :: held 4.332s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:06 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:06 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-cd67c583-1dda-4be4-9cd8-dc1791d11e2a-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-cd67c583-1dda-4be4-9cd8-dc1791d11e2a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:07 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee 1073741824" returned: 0 in 1.346s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" acquired by "delete_volume" :: waited 0.044s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:07 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee Jul 11 18:17:07 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704ba30-d455-4f6d-a2b8-6d5006cfc5ec]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:07 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a Jul 11 18:17:07 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:07 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.042s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:07 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5a4b865-1eaf-4e24-9fd4-f338bd786096 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-234ff076-f61c-4eb7-abad-109c71eca729-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:08 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee" returned: 0 in 0.898s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96122d1d-d532-4adc-b1d4-5304fd8349f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e8215e-dc2d-4b20-8200-c422402aacee', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24842afe-df2b-4f3f-a18b-7b3b3f00afc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Volume volume-60e8215e-dc2d-4b20-8200-c422402aacee (60e8215e-dc2d-4b20-8200-c422402aacee): created successfully Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24842afe-df2b-4f3f-a18b-7b3b3f00afc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (c5a0877f-ed9a-43f8-9b17-3b3842af2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9ec5cee5-0113-42b9-a8fc-766b8a1e351b tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:17:08 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" returned: 0 in 0.945s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:08 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a Jul 11 18:17:08 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:08 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-cd67c583-1dda-4be4-9cd8-dc1791d11e2a" released by "delete_volume" :: held 1.707s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:08 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['2c38c178-2b3e-4cfb-8c32-4a6ff1de9d68', '304dbc89-8a97-4437-8d95-e2993377bae7', '69a60f2b-b923-45c6-aa1e-77830b41c1dc', '09ecad56-a63e-47d0-9650-8cd022e3e3ff'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:09 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:09 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-c12da96a-2da9-47e0-b5fc-6a772dc314b4-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-c12da96a-2da9-47e0-b5fc-6a772dc314b4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-c12da96a-2da9-47e0-b5fc-6a772dc314b4" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-c12da96a-2da9-47e0-b5fc-6a772dc314b4" acquired by "delete_volume" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e79853-6147-46cb-a9ad-e5e3e05c5822]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 1819ef69-36b1-4752-b203-6eb052b5e355 of volume 60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edf9b1-d0ee-4ad2-b810-ef7bef22ccfc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:09 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 Jul 11 18:17:09 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:09 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee Jul 11 18:17:09 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:10 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.992s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3c723413-3347-424d-9859-5c2a34431483 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-cd67c583-1dda-4be4-9cd8-dc1791d11e2a-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:10 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4" returned: 0 in 1.034s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:10 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4 Jul 11 18:17:10 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:10 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee" returned: 0 in 0.996s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:10 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 1G Jul 11 18:17:10 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:11 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c12da96a-2da9-47e0-b5fc-6a772dc314b4" returned: 0 in 0.834s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-c12da96a-2da9-47e0-b5fc-6a772dc314b4" released by "delete_volume" :: held 1.929s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['eaec2bd3-2390-4acf-ac95-71ae9a7b8251', 'b4a7eaf2-507a-4677-8d5d-1c3616ef726b', 'ce1478c1-9f37-401a-a830-3b9a0d4f7495', '3b6a4456-9bf6-4435-af87-d3c9c67063b1'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:11 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 1G" returned: 0 in 0.967s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e8215e-dc2d-4b20-8200-c422402aacee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:11 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:11 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:11 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e8215e-dc2d-4b20-8200-c422402aacee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 Jul 11 18:17:11 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-5ed19448-8c92-4e6e-954e-98a33d2b24c0-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-5ed19448-8c92-4e6e-954e-98a33d2b24c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-5ed19448-8c92-4e6e-954e-98a33d2b24c0" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-5ed19448-8c92-4e6e-954e-98a33d2b24c0" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b61b17-3c82-456c-8b36-47107bbe90ce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:12 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 Jul 11 18:17:12 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (e3270796-2d8c-44a3-8274-5ba45b16ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5cb2e-5795-46a3-bb59-026c1d743f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5cb2e-5795-46a3-bb59-026c1d743f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969871809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e32cd8-da1b-4da1-938f-d1834673a196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:12Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a2b0af-b03c-4288-aba1-00ce588e1733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a2b0af-b03c-4288-aba1-00ce588e1733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acec074-0743-4e3e-967f-401fb701d78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acec074-0743-4e3e-967f-401fb701d78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e32cd8-da1b-4da1-938f-d1834673a196', 'volume_name': 'volume-99e32cd8-da1b-4da1-938f-d1834673a196', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd314cb-2de7-4564-a376-3b9b694df56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd314cb-2de7-4564-a376-3b9b694df56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d8ab2e-aad7-4691-83fe-8cf9ae9c30c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:12 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume 99e32cd8-da1b-4da1-938f-d1834673a196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e32cd8-da1b-4da1-938f-d1834673a196', 'volume_size': 1} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:12 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.718s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fbda8ade-e7ae-4409-aca9-00d6f8659d92 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-c12da96a-2da9-47e0-b5fc-6a772dc314b4-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:12 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e8215e-dc2d-4b20-8200-c422402aacee -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355" returned: 0 in 0.886s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:12 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 is being set with open permissions: ugo+rw Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:12 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 Jul 11 18:17:12 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:12 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0" returned: 0 in 0.855s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:12 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0 Jul 11 18:17:12 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:13 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:13 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info Jul 11 18:17:13 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:13 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5ed19448-8c92-4e6e-954e-98a33d2b24c0" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-5ed19448-8c92-4e6e-954e-98a33d2b24c0" released by "delete_volume" :: held 1.636s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['c3ad647c-2524-4aea-b28e-bdd578509132', 'fc8a5f1f-2996-42fc-bbf2-b70560a7bc2e', 'fd451d5c-75e3-4b37-8e59-2eaa6f0684ab', 'b2bd0098-eab1-4eca-bee2-15fd3fef8008'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:13 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:13 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:13 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info" returned: 0 in 0.678s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:13 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info is being set with open permissions: ugo+rw Jul 11 18:17:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:13 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info Jul 11 18:17:13 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-4e5f057f-2d98-4636-ac7d-25d8b7567d22-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-4e5f057f-2d98-4636-ac7d-25d8b7567d22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-4e5f057f-2d98-4636-ac7d-25d8b7567d22" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-4e5f057f-2d98-4636-ac7d-25d8b7567d22" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7decf2-9313-4966-9b27-c41859adbf16]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:14 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.697s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:14 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 Jul 11 18:17:14 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8e84633-2be1-4d6c-8ba9-ff077e7c51fe tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-5ed19448-8c92-4e6e-954e-98a33d2b24c0-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:14 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.info" returned: 0 in 0.720s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.071s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969871809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e32cd8-da1b-4da1-938f-d1834673a196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:12Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume 99e32cd8-da1b-4da1-938f-d1834673a196 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:14 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:14 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 1073741824 Jul 11 18:17:14 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:14 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c0eaad1c-fad4-423c-a05b-ceecd1dcad13 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:17:15 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22" returned: 0 in 0.930s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:15 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22 Jul 11 18:17:15 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:15 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 1073741824" returned: 0 in 0.879s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:15 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 Jul 11 18:17:15 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:15 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e5f057f-2d98-4636-ac7d-25d8b7567d22" returned: 0 in 0.705s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-4e5f057f-2d98-4636-ac7d-25d8b7567d22" released by "delete_volume" :: held 1.687s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-1819ef69-36b1-4752-b203-6eb052b5e355-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-1819ef69-36b1-4752-b203-6eb052b5e355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['a4216467-004e-4def-9096-89412676c224', 'ae1a3e04-0873-4fe8-92d7-2a82abff8043', 'e396f251-0d68-4495-9f79-cc15cfaebe22', '32e8bf87-328c-484d-82f3-9ba3a6bbaed2'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-1819ef69-36b1-4752-b203-6eb052b5e355" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1819ef69-36b1-4752-b203-6eb052b5e355" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 1819ef69-36b1-4752-b203-6eb052b5e355 of volume 60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ee316-9a60-410e-90ac-938e085ae57b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:16 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:16 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:16 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 Jul 11 18:17:16 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:16 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196" returned: 0 in 0.658s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d8ab2e-aad7-4691-83fe-8cf9ae9c30c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e32cd8-da1b-4da1-938f-d1834673a196', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b257767a-d641-478f-b495-5e5f7d4102c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-99e32cd8-da1b-4da1-938f-d1834673a196 (99e32cd8-da1b-4da1-938f-d1834673a196): created successfully Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b257767a-d641-478f-b495-5e5f7d4102c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (e3270796-2d8c-44a3-8274-5ba45b16ec51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-c2f796f8-eeeb-4619-a9d7-b3472ea29f61-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6530d012-1921-4b57-aa0a-52a3233858ca tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-c2f796f8-eeeb-4619-a9d7-b3472ea29f61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-c2f796f8-eeeb-4619-a9d7-b3472ea29f61" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-c2f796f8-eeeb-4619-a9d7-b3472ea29f61" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleting offline snapshot c2f796f8-eeeb-4619-a9d7-b3472ea29f61 of volume 7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] snapshot_file for this snap is: volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2bff09-0b02-4987-a8c8-94f613f300ab]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:16 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 Jul 11 18:17:16 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:16 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.798s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fea1d834-38fb-4d93-a4f3-078615c3a9a3 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-4e5f057f-2d98-4636-ac7d-25d8b7567d22-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:16 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355" returned: 0 in 0.933s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60e8215e-dc2d-4b20-8200-c422402aacee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d35ea1-ada2-4de3-8bac-645f5943513f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:17 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee Jul 11 18:17:17 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:17 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61" returned: 0 in 0.876s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[884cb792-2fbc-47f5-adb0-3be61f5c180f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:17 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 Jul 11 18:17:17 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (0fdccdee-2ff6-453d-beb6-3d4520dac5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0268d6-8fc6-46c1-bfbe-df99ebc1e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0268d6-8fc6-46c1-bfbe-df99ebc1e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031156415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:18Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b7fe9-1188-4ce5-a84f-a4b60b45fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b7fe9-1188-4ce5-a84f-a4b60b45fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:17 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06795d37-eab7-40e8-a4f6-42df28b789ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06795d37-eab7-40e8-a4f6-42df28b789ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828', 'volume_name': 'volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f265f73-cabd-476c-9419-6a062f50ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f265f73-cabd-476c-9419-6a062f50ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efaa8e6-dd82-4ba5-bf0a-b9c2f9eec7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828', 'volume_size': 1} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031156415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:18Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:18 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee" returned: 0 in 1.067s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:18 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 Jul 11 18:17:18 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:18 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 1073741824 Jul 11 18:17:18 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (6a078dfe-b240-4b12-b09d-b57b1a5715f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493d28a1-d8e0-40e6-b963-479e5da884a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493d28a1-d8e0-40e6-b963-479e5da884a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696483721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d291c4-5a71-465b-8238-79ed167016cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34f57b3-6839-44c7-b852-611e9972f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34f57b3-6839-44c7-b852-611e9972f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df47f69-c256-499e-84f9-0559c64e7b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df47f69-c256-499e-84f9-0559c64e7b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d291c4-5a71-465b-8238-79ed167016cc', 'volume_name': 'volume-e8d291c4-5a71-465b-8238-79ed167016cc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8570e4f6-dbef-4136-850c-b4bf54580fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8570e4f6-dbef-4136-850c-b4bf54580fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c5b36e-fd54-411e-9819-fe6deba97b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume e8d291c4-5a71-465b-8238-79ed167016cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d291c4-5a71-465b-8238-79ed167016cc', 'volume_size': 1} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" returned: 0 in 1.462s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:18 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 Jul 11 18:17:18 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (1213db36-1cf8-4569-86b3-c073913c8132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f36cd89-141b-4505-8741-761b47d571f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f36cd89-141b-4505-8741-761b47d571f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293465786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bc2c97-8bdc-4ce2-b650-3efd20ebff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fbeb58-23ab-483f-8c83-b1868beec707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fbeb58-23ab-483f-8c83-b1868beec707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1d6de-57b3-42a7-9320-51001bc0ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1d6de-57b3-42a7-9320-51001bc0ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0bc2c97-8bdc-4ce2-b650-3efd20ebff95', 'volume_name': 'volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676b2059-a44d-4cb5-8211-26dcfe0d08e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676b2059-a44d-4cb5-8211-26dcfe0d08e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f31c217-e745-418e-b4f5-b17c6a93ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume d0bc2c97-8bdc-4ce2-b650-3efd20ebff95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95', 'volume_size': 1} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:19 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355" returned: 0 in 1.307s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:19 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355 Jul 11 18:17:19 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (71cadcd8-c0f6-45ba-a528-55890964c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b179aa7-ad79-4c70-89f4-36b7753b0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b179aa7-ad79-4c70-89f4-36b7753b0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976082452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64fdb9b-93f2-451b-943c-7ada892000df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f654c17-ca99-4c18-99ac-928f3131201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f654c17-ca99-4c18-99ac-928f3131201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acac508d-863e-455d-ac5f-21cf1fcbe43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acac508d-863e-455d-ac5f-21cf1fcbe43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64fdb9b-93f2-451b-943c-7ada892000df', 'volume_name': 'volume-b64fdb9b-93f2-451b-943c-7ada892000df', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a722d48-9e4a-4fe4-8b61-55568c6a9e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a722d48-9e4a-4fe4-8b61-55568c6a9e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f589aad-5fe0-47ae-932e-1b6bdb127c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume b64fdb9b-93f2-451b-943c-7ada892000df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64fdb9b-93f2-451b-943c-7ada892000df', 'volume_size': 1} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:19 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 1073741824" returned: 0 in 1.547s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:19 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 Jul 11 18:17:19 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:20 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61" returned: 0 in 1.256s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:20 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61 Jul 11 18:17:20 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (a94b9ee7-80d0-4fc4-8c72-a135db205d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd29cb0-733e-4692-a176-431be0a5d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd29cb0-733e-4692-a176-431be0a5d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080318852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002b5c1d-a83e-47b7-89cf-1ccb77c868fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:20Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23d09ed-0e40-4b92-a032-6e549fae9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23d09ed-0e40-4b92-a032-6e549fae9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79449772-aa96-4d48-98df-93a61da06438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79449772-aa96-4d48-98df-93a61da06438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002b5c1d-a83e-47b7-89cf-1ccb77c868fe', 'volume_name': 'volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762d358f-926a-4e8a-8ef8-d766e3772613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762d358f-926a-4e8a-8ef8-d766e3772613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0beeb49-2705-4e2a-82e6-c372c3a35e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume 002b5c1d-a83e-47b7-89cf-1ccb77c868fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe', 'volume_size': 1} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:20 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee.1819ef69-36b1-4752-b203-6eb052b5e355" returned: 0 in 1.068s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:20 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696483721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d291c4-5a71-465b-8238-79ed167016cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume e8d291c4-5a71-465b-8238-79ed167016cc {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:20 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1819ef69-36b1-4752-b203-6eb052b5e355" released by "_delete_snapshot" :: held 4.527s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:20 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc 1073741824 Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efaa8e6-dd82-4ba5-bf0a-b9c2f9eec7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a9ce9c-b2ad-48db-bf90-7fc30832ede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" released by "delete_snapshot" :: held 4.586s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 (cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828): created successfully Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a9ce9c-b2ad-48db-bf90-7fc30832ede6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (0fdccdee-2ff6-453d-beb6-3d4520dac5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-46e8e225-9a86-404d-9103-67a03c4823b2 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Created reservations ['1ce96abf-9c70-419d-8a2f-f3a4c17b02c1', '50455cfb-f37c-469e-8214-618119cc00b9', '58026e54-b58e-4fc8-80ce-dc4805d99384', '83fab8ad-e94f-4458-91db-9b93ef075a7b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3b3edfbe-84e2-4b3c-9abd-115bc8bb8725 tempest-ProjectMemberTests-377075098 None] Lock "cinder-1819ef69-36b1-4752-b203-6eb052b5e355-delete_snapshot" released by "delete_snapshot" :: held 4.802s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:20 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9.c2f796f8-eeeb-4619-a9d7-b3472ea29f61" returned: 0 in 0.796s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-c2f796f8-eeeb-4619-a9d7-b3472ea29f61" released by "_delete_snapshot" :: held 4.527s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" released by "delete_snapshot" :: held 4.556s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['9aa249f5-4f1c-45e1-9b57-28d336884a99', '14c47752-3dfd-4e71-959c-7df740cd0741', 'fba8a3c2-e081-4d02-8ac6-16e302c71c9f', '1430c59c-191b-416b-96ae-5553f8ae2b30'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Delete snapshot completed successfully. Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fd672ab0-fdbd-48ea-900c-dbf7f1db5f71 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-c2f796f8-eeeb-4619-a9d7-b3472ea29f61-delete_snapshot" released by "delete_snapshot" :: held 4.763s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-60e8215e-dc2d-4b20-8200-c422402aacee-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "cinder-60e8215e-dc2d-4b20-8200-c422402aacee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32e129-0354-48a0-ac19-afda23e149f4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:21 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc 1073741824" returned: 0 in 1.002s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:21 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee Jul 11 18:17:21 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:21 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc Jul 11 18:17:21 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" acquired by "delete_volume" :: waited 0.050s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3aa731-ecd0-46e5-af5b-de2b495719ea]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:22 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 Jul 11 18:17:22 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:22 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc" returned: 0 in 0.827s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293465786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bc2c97-8bdc-4ce2-b650-3efd20ebff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:22 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c5b36e-fd54-411e-9819-fe6deba97b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d291c4-5a71-465b-8238-79ed167016cc', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf09ff31-68c2-4e8f-b00e-f6cb882a8682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:22 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 1073741824 Jul 11 18:17:22 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:22 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-e8d291c4-5a71-465b-8238-79ed167016cc (e8d291c4-5a71-465b-8238-79ed167016cc): created successfully Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf09ff31-68c2-4e8f-b00e-f6cb882a8682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (6a078dfe-b240-4b12-b09d-b57b1a5715f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-22e71440-6359-47f4-b51d-6456dbcfa9a6 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:22 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee" returned: 0 in 1.164s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:22 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee Jul 11 18:17:22 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:22 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" returned: 0 in 0.997s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:22 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9 Jul 11 18:17:22 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:23 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-60e8215e-dc2d-4b20-8200-c422402aacee" returned: 0 in 0.873s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:23 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 1073741824" returned: 0 in 1.094s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-60e8215e-dc2d-4b20-8200-c422402aacee" released by "delete_volume" :: held 2.141s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:23 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 Jul 11 18:17:23 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Created reservations ['42f132a5-0ba0-4402-bc2d-c40dec450184', 'fd9a198d-8091-4d17-84b1-bbb84fa7c70a', '22973c0f-df43-4287-a6ad-e8f067f1b811', 'bbfc1c9a-0578-438c-9350-d170dc0709cf'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:23 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:23 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:23 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" returned: 0 in 0.821s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-quobyte-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9" released by "delete_volume" :: held 1.924s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Created reservations ['03b911eb-abd5-4c5d-bb05-0d5a11c0ccc4', '93f564d0-58aa-465a-ba00-1a8520ce1429', '2bcf3616-df9a-45f3-9ac7-4b4bfd50ab61', '85ceb890-4cf2-4a9f-aefe-71da4eae454b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:23 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:23 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:24 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" returned: 0 in 0.913s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.932s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976082452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64fdb9b-93f2-451b-943c-7ada892000df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:19Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume b64fdb9b-93f2-451b-943c-7ada892000df {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:24 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f31c217-e745-418e-b4f5-b17c6a93ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:24 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df 1073741824 Jul 11 18:17:24 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adaa88f-e582-4b9c-b30a-8053dfcfce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:24 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.907s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:17:24 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 (d0bc2c97-8bdc-4ce2-b650-3efd20ebff95): created successfully Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adaa88f-e582-4b9c-b30a-8053dfcfce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (1213db36-1cf8-4569-86b3-c073913c8132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-466a1f2d-f51f-401b-af59-80a266c37a3b tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c426e104-1aaf-4e58-b845-017c9bd4ef10 tempest-ProjectMemberTests-377075098 None] Lock "cinder-60e8215e-dc2d-4b20-8200-c422402aacee-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:24 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:24 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Deleted volume successfully. Jul 11 18:17:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-ebd14a68-e549-471d-b439-6a362f90cc91 tempest-CreateVolumesFromSnapshotTest-1179505205 None] Lock "cinder-7ebfab2b-8bbf-48eb-aeb7-d31ac57fedc9-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (53ffb33a-6cda-4e24-a294-fad2f258a921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceb5a17-bda5-496e-957d-c2659b76f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceb5a17-bda5-496e-957d-c2659b76f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583647258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb499c8-cd8a-4955-80af-798490d825d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:25Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4539121c-fccd-49a3-ba8b-8c3ad7cab65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4539121c-fccd-49a3-ba8b-8c3ad7cab65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba9d401-ce17-4606-a9ae-7721f970cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba9d401-ce17-4606-a9ae-7721f970cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb499c8-cd8a-4955-80af-798490d825d8', 'volume_name': 'volume-3eb499c8-cd8a-4955-80af-798490d825d8', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85ee8a-189e-41ce-9d6f-9db750e57bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85ee8a-189e-41ce-9d6f-9db750e57bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00670c57-6fb3-4acd-9501-2598d08cf029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Volume 3eb499c8-cd8a-4955-80af-798490d825d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb499c8-cd8a-4955-80af-798490d825d8', 'volume_size': 1} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:25 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df 1073741824" returned: 0 in 1.261s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:25 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df Jul 11 18:17:25 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:26 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.243s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080318852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002b5c1d-a83e-47b7-89cf-1ccb77c868fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe778f90e5f4269af4b711e1afceabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:20Z,use_quota=True,user_id='8745078f5fb44ef8aa6fab6936878f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Creating volume 002b5c1d-a83e-47b7-89cf-1ccb77c868fe {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:26 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f589aad-5fe0-47ae-932e-1b6bdb127c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64fdb9b-93f2-451b-943c-7ada892000df', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:26 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe 1073741824 Jul 11 18:17:26 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6353b96a-8f22-40cb-98d0-b346e64e2c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:26 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-b64fdb9b-93f2-451b-943c-7ada892000df (b64fdb9b-93f2-451b-943c-7ada892000df): created successfully Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6353b96a-8f22-40cb-98d0-b346e64e2c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:26 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (71cadcd8-c0f6-45ba-a528-55890964c612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d9033829-8079-4bf3-bb65-3f7ae1f5d1ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:27 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe 1073741824" returned: 0 in 1.179s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Flow 'volume_create_manager' (e588d1d9-225c-43d3-bc93-4af8d46e25ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04d905e-3a8d-41c9-bdfa-2ae2effbe5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04d905e-3a8d-41c9-bdfa-2ae2effbe5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2116414060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1583d-4f49-47fd-b84e-1e186c1725d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb22deb6c10438aad7ffa47963cd4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:28Z,use_quota=True,user_id='261bab0b65c846f2bd5761c0aea54bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:27 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe Jul 11 18:17:27 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba48e001-e943-434a-b14f-23065091bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba48e001-e943-434a-b14f-23065091bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daa90da-729e-42ac-bf04-e2d5d7e2a900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daa90da-729e-42ac-bf04-e2d5d7e2a900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e1583d-4f49-47fd-b84e-1e186c1725d6', 'volume_name': 'volume-98e1583d-4f49-47fd-b84e-1e186c1725d6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938942a4-59a3-4fa2-98da-f1ecd35ecf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938942a4-59a3-4fa2-98da-f1ecd35ecf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff8c735-871c-4108-ae34-163e17f5d9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:27 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Volume 98e1583d-4f49-47fd-b84e-1e186c1725d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e1583d-4f49-47fd-b84e-1e186c1725d6', 'volume_size': 1} Jul 11 18:17:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:28 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583647258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb499c8-cd8a-4955-80af-798490d825d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:25Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Creating volume 3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:28 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0beeb49-2705-4e2a-82e6-c372c3a35e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec6e3c-f6d5-40c5-a03a-c585fae82222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:28 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 1073741824 Jul 11 18:17:28 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:28 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Volume volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe (002b5c1d-a83e-47b7-89cf-1ccb77c868fe): created successfully Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec6e3c-f6d5-40c5-a03a-c585fae82222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Flow 'volume_create_manager' (a94b9ee7-80d0-4fc4-8c72-a135db205d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:28 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f0f3131b-abb9-47ac-9194-d7cd5cd49a16 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created volume successfully. Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-002b5c1d-a83e-47b7-89cf-1ccb77c868fe-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-002b5c1d-a83e-47b7-89cf-1ccb77c868fe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f743081f-5a66-4a85-9adf-a669be16dc98]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:29 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe Jul 11 18:17:29 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:29 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 1073741824" returned: 0 in 0.955s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:29 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 Jul 11 18:17:29 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:30 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" returned: 0 in 0.841s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:30 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe Jul 11 18:17:30 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:30 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8" returned: 0 in 0.698s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.343s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2116414060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1583d-4f49-47fd-b84e-1e186c1725d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb22deb6c10438aad7ffa47963cd4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:28Z,use_quota=True,user_id='261bab0b65c846f2bd5761c0aea54bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Creating volume 98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00670c57-6fb3-4acd-9501-2598d08cf029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb499c8-cd8a-4955-80af-798490d825d8', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e2c21c-5def-4d02-bac3-6e3ea5e5ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:30 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 1073741824 Jul 11 18:17:30 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Volume volume-3eb499c8-cd8a-4955-80af-798490d825d8 (3eb499c8-cd8a-4955-80af-798490d825d8): created successfully Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e2c21c-5def-4d02-bac3-6e3ea5e5ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (53ffb33a-6cda-4e24-a294-fad2f258a921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1f6b4209-7638-4a4e-9c82-5d2e8c7ac1cd tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:31 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" returned: 0 in 0.906s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-002b5c1d-a83e-47b7-89cf-1ccb77c868fe" released by "delete_volume" :: held 1.799s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['760ca716-f267-44be-a34f-210daf8f9c7c', 'efef636f-4cb2-4da1-a76f-9dd52fe047f7', '84d00035-c264-45f9-85ef-ccd37a756e77', 'dbf6b900-3ed4-4ba8-80fa-06863aecc783'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:31 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:31 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:31 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 1073741824" returned: 0 in 0.997s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:31 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:31 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-b64fdb9b-93f2-451b-943c-7ada892000df-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-b64fdb9b-93f2-451b-943c-7ada892000df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-b64fdb9b-93f2-451b-943c-7ada892000df" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-b64fdb9b-93f2-451b-943c-7ada892000df" acquired by "delete_volume" :: waited 0.024s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24d2e5-736c-4813-85c1-195a8b1dac9e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:31 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df Jul 11 18:17:31 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:32 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.763s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-6aabeea4-aaf6-4576-84d3-5e0a5481e73a tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-002b5c1d-a83e-47b7-89cf-1ccb77c868fe-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:32 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.842s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.224s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot e34eadb4-0630-4f9a-aedb-929560a422ed of volume 3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff8c735-871c-4108-ae34-163e17f5d9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e1583d-4f49-47fd-b84e-1e186c1725d6', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4709d867-e79f-495f-8947-758b1a994d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f59296-04b9-4f0e-a5a2-6c007b3763fb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Volume volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 (98e1583d-4f49-47fd-b84e-1e186c1725d6): created successfully Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4709d867-e79f-495f-8947-758b1a994d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Flow 'volume_create_manager' (e588d1d9-225c-43d3-bc93-4af8d46e25ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-124d2beb-ef3d-415f-a8bc-73bea1411a36 tempest-VolumeDependencyTests-1681040521 None] Created volume successfully. Jul 11 18:17:32 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 Jul 11 18:17:32 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:32 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df" returned: 0 in 1.002s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:32 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df Jul 11 18:17:32 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:33 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8" returned: 0 in 0.961s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:33 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed 1G Jul 11 18:17:33 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:33 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-b64fdb9b-93f2-451b-943c-7ada892000df" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-b64fdb9b-93f2-451b-943c-7ada892000df" released by "delete_volume" :: held 1.836s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=154,cinder:UPDATE=211,cinder:INSERT=57,cinder:DELETE=17 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['931c4f1e-060e-4f36-9cd4-24ddb0b084b0', '6aed3d9b-837e-4104-8626-2a75fb6e8ae2', '31388c30-205e-4c88-8974-5c718534b6b8', '0693dcac-70c4-4acb-b1e2-1cb30af3c6c4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:33 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:33 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[39245a2a-2020-4278-9b6e-687c583dfcb0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:34 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:34 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:34 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 Jul 11 18:17:34 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:34 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed 1G" returned: 0 in 1.091s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb499c8-cd8a-4955-80af-798490d825d8 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:34 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb499c8-cd8a-4955-80af-798490d825d8 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed Jul 11 18:17:34 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:34 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.867s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-33701176-7a1c-4744-9da5-e44b8cbc7692 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-b64fdb9b-93f2-451b-943c-7ada892000df-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:35 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.855s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:17:35 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" returned: 0 in 1.129s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:35 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb499c8-cd8a-4955-80af-798490d825d8 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed" returned: 0 in 0.832s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:35 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed is being set with open permissions: ugo+rw Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:35 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95 Jul 11 18:17:35 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:35 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed Jul 11 18:17:35 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:35 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed" returned: 0 in 0.700s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:35 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" returned: 0 in 0.729s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95" released by "delete_volume" :: held 1.918s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:35 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info Jul 11 18:17:35 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:35 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['f7568009-359a-4b55-a147-b7a731a21247', '80a34356-0b5b-41e6-a9c3-01b87cab5026', '119ced63-0f02-493c-8041-fd05dc19fea5', '3ebb40e0-9f15-45ea-9503-8d96c2bb030d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:36 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:36 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-e8d291c4-5a71-465b-8238-79ed167016cc-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-e8d291c4-5a71-465b-8238-79ed167016cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-e8d291c4-5a71-465b-8238-79ed167016cc" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-e8d291c4-5a71-465b-8238-79ed167016cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143e687-899e-4129-96a0-c6fde5e13a67]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:36 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc Jul 11 18:17:36 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:36 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:36 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info is being set with open permissions: ugo+rw Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:36 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info Jul 11 18:17:36 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:36 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd16fba3-02da-4f8d-8685-d672130c2fae tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-d0bc2c97-8bdc-4ce2-b650-3efd20ebff95-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:37 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc" returned: 0 in 0.930s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:37 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc Jul 11 18:17:37 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:37 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.info" returned: 0 in 0.750s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.234s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.886s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Creating offline snapshot d9076b25-45a9-4dc3-92dc-caaf927cef95 of volume 98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:17:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f24ac103-ed00-493b-98e7-84a791ffa957 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[64116e2c-129e-41bc-88f9-ed97f85c882e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:37 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:37 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:37 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e8d291c4-5a71-465b-8238-79ed167016cc" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-e8d291c4-5a71-465b-8238-79ed167016cc" released by "delete_volume" :: held 1.721s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['5d682b34-3747-4dff-ad02-97e6af74d245', '659e27f4-5447-4e13-beeb-446f23f9e840', 'b7fe865b-02c8-4ca6-9742-ee63a0711604', '2a7bc3a1-8393-46ef-8120-2ce680c51498'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:38 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:38 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:38 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.834s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:38 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 1G Jul 11 18:17:38 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-e34eadb4-0630-4f9a-aedb-929560a422ed-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-e34eadb4-0630-4f9a-aedb-929560a422ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-e34eadb4-0630-4f9a-aedb-929560a422ed" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-e34eadb4-0630-4f9a-aedb-929560a422ed" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot e34eadb4-0630-4f9a-aedb-929560a422ed of volume 3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfced50-2eb9-458c-a895-57e0354b33af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3735cd1-a9ef-4963-8555-bab9681ba9a4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:38 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed Jul 11 18:17:38 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:38 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 Jul 11 18:17:38 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:38 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.851s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:38 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:38 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-566183fa-fb2f-4610-b804-5d1cd774bf3d tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-e8d291c4-5a71-465b-8238-79ed167016cc-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:39 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 1G" returned: 0 in 1.220s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:39 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:39 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:39 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed" returned: 0 in 1.178s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb499c8-cd8a-4955-80af-798490d825d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:17:39 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" returned: 0 in 1.128s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48b384-1c76-415f-84ae-909f37bf1aeb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:39 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828 Jul 11 18:17:39 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:39 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 Jul 11 18:17:39 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:40 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 0.920s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:40 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 is being set with open permissions: ugo+rw Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:40 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:40 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:40 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828" released by "delete_volume" :: held 2.034s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['93cc2d91-a5bd-4ec2-867c-8e10e414891a', '1657c4bc-719a-48bc-a13a-dc44fabeee91', '949954c2-4ff6-464e-9aa5-54c70c03992c', 'f4a88d63-17c1-4540-9ec9-4e7af5bbd7f7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:40 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:40 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:40 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8" returned: 0 in 1.109s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:41 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed Jul 11 18:17:41 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:41 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 0.857s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:41 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info Jul 11 18:17:41 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-99e32cd8-da1b-4da1-938f-d1834673a196-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:41 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.083s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:41 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-99e32cd8-da1b-4da1-938f-d1834673a196-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-c5d98f78-9d6d-4203-85fb-979e14ca68ee tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-cadb5f69-5a57-4c37-b2b5-d5bb1cf4c828-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "cinder-quobyte-99e32cd8-da1b-4da1-938f-d1834673a196" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-99e32cd8-da1b-4da1-938f-d1834673a196" acquired by "delete_volume" :: waited 0.037s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cdc1c9-bb9e-4388-a9f1-c95eebcc2623]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:42 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 Jul 11 18:17:42 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:42 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed" returned: 0 in 1.462s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:42 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed Jul 11 18:17:42 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:42 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info" returned: 0 in 1.075s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:42 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info is being set with open permissions: ugo+rw Jul 11 18:17:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:42 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info Jul 11 18:17:42 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:43 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196" returned: 0 in 0.950s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:43 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196 Jul 11 18:17:43 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:43 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8.e34eadb4-0630-4f9a-aedb-929560a422ed" returned: 0 in 0.850s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-e34eadb4-0630-4f9a-aedb-929560a422ed" released by "_delete_snapshot" :: held 4.767s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" released by "delete_snapshot" :: held 4.807s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:43 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.info" returned: 0 in 0.847s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.891s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-83106f9f-4268-4602-babe-0390b6b709c9 tempest-VolumeDependencyTests-1681040521 None] Create snapshot completed successfully Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Created reservations ['9d54ec9f-d3cb-4d17-a78c-c8f0d7209c83', '986b4860-0905-4429-acd7-7e9d46a1a95c', '31fcf101-2f29-4f2e-81c4-beef8acc6401', '1ab54fad-ac04-40df-94b7-bb1f70270d3a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:43 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1effa8b3-0fba-4a8d-9b77-2f91d47fe466 tempest-ProjectMemberTests-377075098 None] Lock "cinder-e34eadb4-0630-4f9a-aedb-929560a422ed-delete_snapshot" released by "delete_snapshot" :: held 5.022s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-3eb499c8-cd8a-4955-80af-798490d825d8-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "cinder-3eb499c8-cd8a-4955-80af-798490d825d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:44 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-99e32cd8-da1b-4da1-938f-d1834673a196" returned: 0 in 0.894s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-quobyte-99e32cd8-da1b-4da1-938f-d1834673a196" released by "delete_volume" :: held 1.916s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" acquired by "delete_volume" :: waited 0.042s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd5ca37-1bf1-4ca5-b59f-df260533e5f1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Created reservations ['0ec65144-a60c-4428-8d6b-1b24b50c5d1c', 'e4f3e207-35c9-41b1-a4b2-034b19ddfea8', 'ffdd2766-500e-45b5-afca-8b2cc595d4bb', '7d955c9c-fd17-4b22-8713-3a29c7b3da32'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:44 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 Jul 11 18:17:44 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:44 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:44 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Flow 'volume_create_manager' (5a39b0d8-4245-45ec-bfeb-3ad36f45ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c6462-ab68-40e9-aa00-054f7646c0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c6462-ab68-40e9-aa00-054f7646c0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769807337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480c8d8c-089a-49bc-ba6a-4fafa4ba0996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb22deb6c10438aad7ffa47963cd4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9076b25-45a9-4dc3-92dc-caaf927cef95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:45Z,use_quota=True,user_id='261bab0b65c846f2bd5761c0aea54bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf8e542-d83d-40a6-9dfe-09052c831d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf8e542-d83d-40a6-9dfe-09052c831d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6ffcd6-e8cf-4972-8477-85c691f187bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6ffcd6-e8cf-4972-8477-85c691f187bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '480c8d8c-089a-49bc-ba6a-4fafa4ba0996', 'volume_name': 'volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996', 'volume_size': 1, 'snapshot_id': 'd9076b25-45a9-4dc3-92dc-caaf927cef95'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab522a9-848b-46cd-a9c6-bbad2a4fc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab522a9-848b-46cd-a9c6-bbad2a4fc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ca5d05-efc6-473e-a06e-8bd177052768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:45 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Volume 480c8d8c-089a-49bc-ba6a-4fafa4ba0996: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996', 'volume_size': 1, 'snapshot_id': 'd9076b25-45a9-4dc3-92dc-caaf927cef95'} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Creating volume 480c8d8c-089a-49bc-ba6a-4fafa4ba0996 from snapshot d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] snapshot: d9076b25-45a9-4dc3-92dc-caaf927cef95, volume: 480c8d8c-089a-49bc-ba6a-4fafa4ba0996, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:45 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5964036-cadb-47fb-9894-f691464cd1ac]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 1.038s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:45 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Deleted volume successfully. Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-21f20d4a-0ad3-4226-b203-173dd81ddd22 tempest-CreateVolumesFromSourceVolumeTest-1724327507 None] Lock "cinder-99e32cd8-da1b-4da1-938f-d1834673a196-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:45 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8" returned: 0 in 1.308s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:45 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8 Jul 11 18:17:45 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:45 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:45 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:46 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 1.134s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e1583d-4f49-47fd-b84e-1e186c1725d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075d11f-4315-422d-bff8-411f73919734]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:46 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-3eb499c8-cd8a-4955-80af-798490d825d8" returned: 0 in 1.117s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-3eb499c8-cd8a-4955-80af-798490d825d8" released by "delete_volume" :: held 2.518s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:46 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:46 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Created reservations ['523e6421-c30e-48cc-a748-5bc0d566f95e', '2fa2193f-32af-41f6-a4f5-9546a6578485', '9e8ef919-6d30-4924-85f8-ac95420f46e2', 'f4857b18-b264-469b-b9c1-4cbb05399d3a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:46 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:17:46 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Flow 'volume_create_manager' (7e1b97a6-eee0-4037-a254-75d671336b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:47 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9804a683-5dd0-420c-ab69-21b435d9fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:17:47 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9804a683-5dd0-420c-ab69-21b435d9fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-876597617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19d92f2-8fba-49f0-80ec-d43f2c7e1a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759ff6f4275347549164463fb3855590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:47Z,use_quota=True,user_id='bce6f39618fe4f5099aecec18a6cf6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6ddd9-53de-4ca9-9f68-57fd94f84ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6ddd9-53de-4ca9-9f68-57fd94f84ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87d6fda-83e7-44b1-9416-5ca7ecdd5547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87d6fda-83e7-44b1-9416-5ca7ecdd5547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19d92f2-8fba-49f0-80ec-d43f2c7e1a36', 'volume_name': 'volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daf8063-3d75-440a-87a5-05582686bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daf8063-3d75-440a-87a5-05582686bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8cb4ce-a329-427b-8317-70dc52d6a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Volume d19d92f2-8fba-49f0-80ec-d43f2c7e1a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36', 'volume_size': 1} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 1.167s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:47 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 Jul 11 18:17:47 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-4c7d1212-229e-4d56-9bb5-fad46dba5099 tempest-ProjectMemberTests-377075098 None] Lock "cinder-3eb499c8-cd8a-4955-80af-798490d825d8-delete_volume" released by "delete_volume" :: held 3.773s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (fecfbbfa-82b5-430c-ab0f-3a96aa087fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de950933-4272-421f-8917-a0cad9655d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:47 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de950933-4272-421f-8917-a0cad9655d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215842992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e8b77-286f-4a88-a25c-5b0e346e9256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:48Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da0bc51-2996-4fa2-aaab-34d3479d7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da0bc51-2996-4fa2-aaab-34d3479d7485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486e96be-7d94-42fc-a4f7-aba402ff885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486e96be-7d94-42fc-a4f7-aba402ff885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209e8b77-286f-4a88-a25c-5b0e346e9256', 'volume_name': 'volume-209e8b77-286f-4a88-a25c-5b0e346e9256', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e9aca-52dc-4019-96d0-5b493004542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e9aca-52dc-4019-96d0-5b493004542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886ca7ae-695e-4b79-b545-3072243a2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Volume 209e8b77-286f-4a88-a25c-5b0e346e9256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209e8b77-286f-4a88-a25c-5b0e346e9256', 'volume_size': 1} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Flow 'volume_create_manager' (91d7fc8a-b9c4-4cf9-94a3-f311a995787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b302c-c10d-43a1-bf24-60fbd922a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b302c-c10d-43a1-bf24-60fbd922a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d681d3-e475-45ca-9737-a00208728e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6251936eac624a97bc900df5340ba777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:49Z,use_quota=True,user_id='2f87d096e9704bf9b7320b359312cafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1ca96-ec90-4f8d-b154-17e29d26bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1ca96-ec90-4f8d-b154-17e29d26bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebca3fe-4459-417a-be67-663440c07cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebca3fe-4459-417a-be67-663440c07cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d681d3-e475-45ca-9737-a00208728e23', 'volume_name': 'volume-c7d681d3-e475-45ca-9737-a00208728e23', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23348ea6-695d-4e7a-ba82-361ef5ad837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23348ea6-695d-4e7a-ba82-361ef5ad837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0f425-e574-4241-8601-53c20b81e5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:48 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Volume c7d681d3-e475-45ca-9737-a00208728e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d681d3-e475-45ca-9737-a00208728e23', 'volume_size': 1} Jul 11 18:17:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:52 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" returned: 0 in 4.920s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d7bb1b-a34f-41a0-91a2-6e9abca9aa7d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:52 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:52 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:53 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.932s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:53 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:17:53 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Converted 1024.00 MB image at 208.09 MB/s Jul 11 18:17:53 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 is being set with open permissions: ugo+rw Jul 11 18:17:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:53 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 Jul 11 18:17:53 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:54 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" returned: 0 in 0.650s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" released by "_copy_volume_from_snapshot" :: held 8.944s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" released by "_create_volume_from_snapshot" :: held 8.999s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.019s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.547s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-876597617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19d92f2-8fba-49f0-80ec-d43f2c7e1a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759ff6f4275347549164463fb3855590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:47Z,use_quota=True,user_id='bce6f39618fe4f5099aecec18a6cf6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Creating volume d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:54 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:54 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 1073741824 Jul 11 18:17:54 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ca5d05-efc6-473e-a06e-8bd177052768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996', 'volume_size': 1, 'snapshot_id': 'd9076b25-45a9-4dc3-92dc-caaf927cef95'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305249ee-4ee6-4773-b0b2-960bb534f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:54 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Volume volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 (480c8d8c-089a-49bc-ba6a-4fafa4ba0996): created successfully Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305249ee-4ee6-4773-b0b2-960bb534f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Flow 'volume_create_manager' (5a39b0d8-4245-45ec-bfeb-3ad36f45ee12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-962e91af-bc9a-4105-9d3c-263013b2e831 tempest-VolumeDependencyTests-1681040521 None] Created volume successfully. Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-d9076b25-45a9-4dc3-92dc-caaf927cef95-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-d9076b25-45a9-4dc3-92dc-caaf927cef95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Deleting offline snapshot d9076b25-45a9-4dc3-92dc-caaf927cef95 of volume 98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] snapshot_file for this snap is: volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ab0c8-de8b-493c-9d61-f8c948cd0d1e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:54 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:54 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:55 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 1073741824" returned: 0 in 0.846s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:55 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:17:55 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:55 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e1583d-4f49-47fd-b84e-1e186c1725d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4c414-c6c7-47da-b324-aad93a7edc23]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:55 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.667s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:55 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:55 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.730s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215842992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e8b77-286f-4a88-a25c-5b0e346e9256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:48Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Creating volume 209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:55 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:55 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 1073741824 Jul 11 18:17:55 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8cb4ce-a329-427b-8317-70dc52d6a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b5d3ec-4334-4eac-bb63-6e74459176f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:55 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Volume volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 (d19d92f2-8fba-49f0-80ec-d43f2c7e1a36): created successfully Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b5d3ec-4334-4eac-bb63-6e74459176f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:55 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Flow 'volume_create_manager' (7e1b97a6-eee0-4037-a254-75d671336b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-297ba143-a43b-4fb7-8dd4-e7b57da41f97 tempest-SnapshotDependencyTests-1469042880 None] Created volume successfully. Jul 11 18:17:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:56 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.817s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:56 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:56 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:56 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 1073741824" returned: 0 in 0.875s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:56 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 Jul 11 18:17:56 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:57 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 0.735s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:57 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95 Jul 11 18:17:57 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:57 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.492s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d681d3-e475-45ca-9737-a00208728e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6251936eac624a97bc900df5340ba777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:17:49Z,use_quota=True,user_id='2f87d096e9704bf9b7320b359312cafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Creating volume c7d681d3-e475-45ca-9737-a00208728e23 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:17:57 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886ca7ae-695e-4b79-b545-3072243a2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209e8b77-286f-4a88-a25c-5b0e346e9256', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f6c260-b258-4137-b97c-e72be2bfddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:57 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 1073741824 Jul 11 18:17:57 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:57 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Volume volume-209e8b77-286f-4a88-a25c-5b0e346e9256 (209e8b77-286f-4a88-a25c-5b0e346e9256): created successfully Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f6c260-b258-4137-b97c-e72be2bfddd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (fecfbbfa-82b5-430c-ab0f-3a96aa087fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:57 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ff400a18-d1bc-4903-b6dc-c5845ed34c17 tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:17:57 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6.d9076b25-45a9-4dc3-92dc-caaf927cef95" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-d9076b25-45a9-4dc3-92dc-caaf927cef95" released by "_delete_snapshot" :: held 3.108s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" released by "delete_snapshot" :: held 3.138s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:17:57 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Created reservations ['153de66d-7c78-4ad9-b7d7-37ca6c6bb010', '69714f95-7c50-4053-b61c-4da920265f8e', '96bff7fa-4913-4593-a490-9e92ae78a039', 'e75c6c78-f460-47f0-8983-896589ba5c35'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:17:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Delete snapshot completed successfully. Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d42dc065-dc4b-4399-bc53-d2d678afea22 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-d9076b25-45a9-4dc3-92dc-caaf927cef95-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:17:58 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 1073741824" returned: 0 in 0.919s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:58 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 Jul 11 18:17:58 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:58 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.535s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Creating offline snapshot 7e344e8b-479d-4226-8383-b2ef6f92ca1c of volume d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0f425-e574-4241-8601-53c20b81e5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d681d3-e475-45ca-9737-a00208728e23', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c089f84e-9c52-4779-89a4-553af9c8dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d74770-fcba-4ccb-b2cd-eab5a62688ad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:59 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Volume volume-c7d681d3-e475-45ca-9737-a00208728e23 (c7d681d3-e475-45ca-9737-a00208728e23): created successfully Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c089f84e-9c52-4779-89a4-553af9c8dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Flow 'volume_create_manager' (91d7fc8a-b9c4-4cf9-94a3-f311a995787e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-98e1583d-4f49-47fd-b84e-1e186c1725d6-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-98e1583d-4f49-47fd-b84e-1e186c1725d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7d164a14-4d01-49ba-8f01-14c0aedb5e61 tempest-CinderUnicodeTest-1104240593 None] Created volume successfully. Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:17:59 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:17:59 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b58ae-fe4c-4c7b-b35d-5e6fda45aa71]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:59 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:17:59 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:59 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.791s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:17:59 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c 1G Jul 11 18:17:59 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:17:59 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.812s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:17:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:00 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6 Jul 11 18:18:00 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Flow 'volume_create_manager' (a36e4a2f-a2df-43ce-91a1-d1c6beb4ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b830c3ff-7907-4886-a589-c8f4616247f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b830c3ff-7907-4886-a589-c8f4616247f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2016633987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90c004-e8c2-459b-a619-8ccbb0bd2e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6251936eac624a97bc900df5340ba777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:00Z,use_quota=True,user_id='2f87d096e9704bf9b7320b359312cafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88064a6e-4296-4477-bb88-b6d5885327b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88064a6e-4296-4477-bb88-b6d5885327b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e4ff83-30a6-4d9f-80e9-3d42b1b9bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e4ff83-30a6-4d9f-80e9-3d42b1b9bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc90c004-e8c2-459b-a619-8ccbb0bd2e9f', 'volume_name': 'volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe434e-12e3-4d64-96e1-4487ad3e8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe434e-12e3-4d64-96e1-4487ad3e8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad687844-a2fb-4288-9bb8-5c3e383a884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:00 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Volume bc90c004-e8c2-459b-a619-8ccbb0bd2e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f', 'volume_size': 1} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:00 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c 1G" returned: 0 in 0.843s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:00 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:00 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:00 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-98e1583d-4f49-47fd-b84e-1e186c1725d6" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-98e1583d-4f49-47fd-b84e-1e186c1725d6" released by "delete_volume" :: held 1.568s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Created reservations ['8d38244b-88f4-4fb4-a3b8-f6cf4cf8e208', '0d928cbf-372c-4bfb-bb22-3ff1b4ee7bd6', '5a11fc21-547e-4754-8435-3eb5d844586a', '1c44231d-1839-48f8-88c1-9a5e3fa375a0'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:00 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:00 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-480c8d8c-089a-49bc-ba6a-4fafa4ba0996-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-480c8d8c-089a-49bc-ba6a-4fafa4ba0996-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb2743-31f5-4252-8664-507011f4b4e0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:01 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:01 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c is being set with open permissions: ugo+rw Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:01 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:01 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:01 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.664s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Deleted volume successfully. Jul 11 18:18:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5b9860d8-d55b-4fd5-80a1-a4ccd84463e7 tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-98e1583d-4f49-47fd-b84e-1e186c1725d6-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:01 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 Jul 11 18:18:01 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:02 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.664s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:02 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info Jul 11 18:18:02 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:02 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" returned: 0 in 0.774s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:02 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996 Jul 11 18:18:02 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:02 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info" returned: 0 in 0.667s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:02 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info is being set with open permissions: ugo+rw Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:02 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info Jul 11 18:18:02 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:02 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" returned: 0 in 0.656s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-quobyte-480c8d8c-089a-49bc-ba6a-4fafa4ba0996" released by "delete_volume" :: held 1.473s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Created reservations ['d7634c84-43b8-4f9d-9558-4300af6e77dd', 'c6ea75d7-889d-4beb-9e25-6fcad1ed80f0', '053af5e3-1a07-4c5e-8804-c3a5775a3dba', 'bc67b3c1-92c8-41ac-b3f6-e3525c6cab27'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:02 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:02 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:03 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.info" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.477s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 76a55219-665f-43dd-a327-d24b88bc0e70 of volume 209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d6ec12bb-3623-427f-a680-94a04bce70b7 tempest-SnapshotDependencyTests-1469042880 None] Create snapshot completed successfully Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac904f-f265-4304-b759-aad196a24513]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:03 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.670s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:03 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 Jul 11 18:18:03 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Deleted volume successfully. Jul 11 18:18:03 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-9033e5e0-bd66-4721-8959-75c8ea97bb1c tempest-VolumeDependencyTests-1681040521 None] Lock "cinder-480c8d8c-089a-49bc-ba6a-4fafa4ba0996-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=145,cinder:INSERT=53,cinder:UPDATE=203,cinder:DELETE=20 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:04 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256" returned: 0 in 0.934s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:04 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 1G Jul 11 18:18:04 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Flow 'volume_create_manager' (ddbbf62f-8992-4dd6-93cd-ba9ad38a6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b787f3-a132-40e6-81e2-6339f1d322f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b787f3-a132-40e6-81e2-6339f1d322f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc63c853-ad6d-425b-80de-7dad31e563ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759ff6f4275347549164463fb3855590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e344e8b-479d-4226-8383-b2ef6f92ca1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:04Z,use_quota=True,user_id='bce6f39618fe4f5099aecec18a6cf6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f63eea9-47dc-446d-b6c8-7ee07b811540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f63eea9-47dc-446d-b6c8-7ee07b811540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a0b9cd-c1af-45ab-b7af-c5da6b488c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a0b9cd-c1af-45ab-b7af-c5da6b488c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc63c853-ad6d-425b-80de-7dad31e563ba', 'volume_name': 'volume-bc63c853-ad6d-425b-80de-7dad31e563ba', 'volume_size': 1, 'snapshot_id': '7e344e8b-479d-4226-8383-b2ef6f92ca1c'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0805ae6e-0eeb-45ed-80e4-38bca7e428df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0805ae6e-0eeb-45ed-80e4-38bca7e428df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb18e0d-1984-4ab2-8363-abf1edec464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:04 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Volume bc63c853-ad6d-425b-80de-7dad31e563ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc63c853-ad6d-425b-80de-7dad31e563ba', 'volume_size': 1, 'snapshot_id': '7e344e8b-479d-4226-8383-b2ef6f92ca1c'} Jul 11 18:18:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:05 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 1G" returned: 0 in 0.813s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209e8b77-286f-4a88-a25c-5b0e346e9256 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:05 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209e8b77-286f-4a88-a25c-5b0e346e9256 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 Jul 11 18:18:05 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:05 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209e8b77-286f-4a88-a25c-5b0e346e9256 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70" returned: 0 in 0.716s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:05 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 is being set with open permissions: ugo+rw Jul 11 18:18:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:05 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 Jul 11 18:18:05 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:06 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:06 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info Jul 11 18:18:06 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:07 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info" returned: 0 in 0.623s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:07 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info is being set with open permissions: ugo+rw Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:07 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info Jul 11 18:18:07 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (c710532d-e8dc-4c1a-9c53-717f6d8bfbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43673723-73d8-4ef1-b49d-9a436cc62870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43673723-73d8-4ef1-b49d-9a436cc62870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889509004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea4314a-a6ae-43e0-bcd1-c7c490f90721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:08Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b363a-03cf-45a0-a758-9f6c7641cab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b363a-03cf-45a0-a758-9f6c7641cab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165d5161-eb53-4164-85a9-1230b673a679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165d5161-eb53-4164-85a9-1230b673a679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea4314a-a6ae-43e0-bcd1-c7c490f90721', 'volume_name': 'volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1327a0-48c3-442a-8063-8343a0ffe7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1327a0-48c3-442a-8063-8343a0ffe7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16670172-885d-4370-b2b7-3b0c3d81e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Volume 2ea4314a-a6ae-43e0-bcd1-c7c490f90721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721', 'volume_size': 1} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:07 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.info" returned: 0 in 0.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.489s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.835s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2016633987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90c004-e8c2-459b-a619-8ccbb0bd2e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6251936eac624a97bc900df5340ba777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:00Z,use_quota=True,user_id='2f87d096e9704bf9b7320b359312cafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Creating volume bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:07 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:07 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f 1073741824 Jul 11 18:18:07 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:07 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f785a476-e00e-4402-a66c-45687746b0ac tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-76a55219-665f-43dd-a327-d24b88bc0e70-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-76a55219-665f-43dd-a327-d24b88bc0e70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-76a55219-665f-43dd-a327-d24b88bc0e70" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-76a55219-665f-43dd-a327-d24b88bc0e70" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 76a55219-665f-43dd-a327-d24b88bc0e70 of volume 209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[332ea853-7447-4ef2-a18a-c45da6e285c2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:08 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 Jul 11 18:18:08 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:08 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f 1073741824" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:08 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f Jul 11 18:18:08 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70" returned: 0 in 0.747s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209e8b77-286f-4a88-a25c-5b0e346e9256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0633a998-c120-47fd-8655-a164457c42fd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:09 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 Jul 11 18:18:09 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:09 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" returned: 0 in 0.677s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.997s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c-bc63c853-ad6d-425b-80de-7dad31e563ba" by "_create_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad687844-a2fb-4288-9bb8-5c3e383a884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b813da43-45aa-40d4-a265-6f3ccb3ce17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c-bc63c853-ad6d-425b-80de-7dad31e563ba" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Creating volume bc63c853-ad6d-425b-80de-7dad31e563ba from snapshot 7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" by "_copy_volume_from_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Volume volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f (bc90c004-e8c2-459b-a619-8ccbb0bd2e9f): created successfully Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b813da43-45aa-40d4-a265-6f3ccb3ce17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Flow 'volume_create_manager' (a36e4a2f-a2df-43ce-91a1-d1c6beb4ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] snapshot: 7e344e8b-479d-4226-8383-b2ef6f92ca1c, volume: bc63c853-ad6d-425b-80de-7dad31e563ba, {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:18:09 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-80599585-b91f-4590-94c7-d9b3e227fbb6 tempest-CinderUnicodeTest-1104240593 None] Created volume successfully. Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6583c2-6398-46a1-ad65-323b3d196c2b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:09 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:09 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:10 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256" returned: 0 in 0.765s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:10 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 Jul 11 18:18:10 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:10 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Creating direct copy from snapshot {{(pid=86932) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837b8ac-03b5-4689-b423-08be1a749f03]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:10 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:18:10 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:10 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70" returned: 0 in 0.818s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:10 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70 Jul 11 18:18:10 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:11 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.802s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG cinder.utils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Path /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba not found in is_blk_device check {{(pid=86932) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:11 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba Jul 11 18:18:11 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:11 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256.76a55219-665f-43dd-a327-d24b88bc0e70" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-76a55219-665f-43dd-a327-d24b88bc0e70" released by "_delete_snapshot" :: held 3.091s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" released by "delete_snapshot" :: held 3.117s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Created reservations ['6226fcd7-94d1-4b56-a63b-3293d2e3c221', 'b4a6f923-f4c5-44e4-86da-434010dca466', '582a66a9-4c8d-4207-956b-7f22de50a631', '7b12d788-ebf9-470c-9c41-20541ad0a295'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:18:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-141e604a-fa7d-4d53-acc8-10d312d9a6ef tempest-ProjectMemberTests-377075098 None] Lock "cinder-76a55219-665f-43dd-a327-d24b88bc0e70-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-209e8b77-286f-4a88-a25c-5b0e346e9256-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "cinder-209e8b77-286f-4a88-a25c-5b0e346e9256-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" acquired by "delete_volume" :: waited 0.069s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:13 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff7d55a-ce90-4367-9a10-b9b215fd25dd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:13 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 Jul 11 18:18:13 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:14 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256" returned: 0 in 1.612s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:14 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256 Jul 11 18:18:14 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:16 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-209e8b77-286f-4a88-a25c-5b0e346e9256" returned: 0 in 1.330s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-209e8b77-286f-4a88-a25c-5b0e346e9256" released by "delete_volume" :: held 3.073s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Created reservations ['0ae86ad1-3e35-493f-83ec-76477177a52c', 'e02522e4-29c0-495b-a805-7bcdc468e6a4', '6df6982b-66fd-495e-bd0e-4fe6db5294dc', 'b06af8a7-e04a-4f14-ab4d-3d54a6735af8'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:16 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba" returned: 0 in 4.905s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25030fd-f716-4fa9-871c-24dd5d9b54c8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:16 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:16 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:16 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:18:16 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:16 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:16 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (12b8dce1-6b82-4a94-95d4-2353a654e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f2f9e-7215-4d15-bcc9-e2d8fdacc773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d8060da5-e591-4798-9bd4-a64ad0e3debe tempest-ProjectMemberTests-377075098 None] Lock "cinder-209e8b77-286f-4a88-a25c-5b0e346e9256-delete_volume" released by "delete_volume" :: held 4.161s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f2f9e-7215-4d15-bcc9-e2d8fdacc773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073301456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a286fa66-bad0-40f1-983a-7a3a86d9eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:17Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdd8b13-b518-4eca-a2af-2f41bc4843e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdd8b13-b518-4eca-a2af-2f41bc4843e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55496df7-15f8-4306-ae59-c2a7356bbde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55496df7-15f8-4306-ae59-c2a7356bbde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a286fa66-bad0-40f1-983a-7a3a86d9eabf', 'volume_name': 'volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e71209-b27d-4b04-af58-027473822c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e71209-b27d-4b04-af58-027473822c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26826cd5-57d4-4182-b7cc-3a8ea97f0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Volume a286fa66-bad0-40f1-983a-7a3a86d9eabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf', 'volume_size': 1} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:17 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.967s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.image.image_utils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Image conversion details: src /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba {{(pid=86932) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:18:17 devstack cinder-volume[86932]: INFO cinder.image.image_utils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Converted 1024.00 MB image at 208.70 MB/s Jul 11 18:18:17 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba is being set with open permissions: ugo+rw Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:17 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba Jul 11 18:18:17 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:17 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba" returned: 0 in 0.617s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" released by "_copy_volume_from_snapshot" :: held 8.171s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c-bc63c853-ad6d-425b-80de-7dad31e563ba" released by "_create_volume_from_snapshot" :: held 8.214s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.257s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.929s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889509004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea4314a-a6ae-43e0-bcd1-c7c490f90721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:08Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Creating volume 2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:17 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:17 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 1073741824 Jul 11 18:18:17 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb18e0d-1984-4ab2-8363-abf1edec464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc63c853-ad6d-425b-80de-7dad31e563ba', 'volume_size': 1, 'snapshot_id': '7e344e8b-479d-4226-8383-b2ef6f92ca1c'}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8be981-dcc4-4ee4-9a71-21d948053c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Volume volume-bc63c853-ad6d-425b-80de-7dad31e563ba (bc63c853-ad6d-425b-80de-7dad31e563ba): created successfully Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8be981-dcc4-4ee4-9a71-21d948053c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Flow 'volume_create_manager' (ddbbf62f-8992-4dd6-93cd-ba9ad38a6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-de815805-3e17-4392-9257-00eb622f1234 tempest-SnapshotDependencyTests-1469042880 None] Created volume successfully. Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-7e344e8b-479d-4226-8383-b2ef6f92ca1c-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-7e344e8b-479d-4226-8383-b2ef6f92ca1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Deleting offline snapshot 7e344e8b-479d-4226-8383-b2ef6f92ca1c of volume d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] snapshot_file for this snap is: volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad137e-5d73-4b7b-bbcc-2eb782b45814]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:18 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 1073741824" returned: 0 in 0.854s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:18 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:18 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:18 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 Jul 11 18:18:18 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:19 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.749s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[29837db2-56bd-40d6-8df0-c3c77e5991fb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:19 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" returned: 0 in 0.711s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.507s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16670172-885d-4370-b2b7-3b0c3d81e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545bde1d-3adb-44f0-ac08-c941dd82cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Creating offline snapshot 99859ae8-f2a3-4a94-811e-ea5b0248ec25 of volume bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:19 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Volume volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 (2ea4314a-a6ae-43e0-bcd1-c7c490f90721): created successfully Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545bde1d-3adb-44f0-ac08-c941dd82cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (c710532d-e8dc-4c1a-9c53-717f6d8bfbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ae4b6-37b7-47a4-9f00-82e80b3c7fa3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bb4c0653-1f75-40b7-a03a-abfbe54d96a8 tempest-ProjectReaderTests-913399553 None] Created volume successfully. Jul 11 18:18:19 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:18:19 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:19 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f Jul 11 18:18:19 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:20 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.829s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:20 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:20 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:20 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" returned: 0 in 0.829s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:20 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 1G Jul 11 18:18:20 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:20 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.775s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:21 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c Jul 11 18:18:21 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:21 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 1G" returned: 0 in 0.817s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:21 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 Jul 11 18:18:21 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:21 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36.7e344e8b-479d-4226-8383-b2ef6f92ca1c" returned: 0 in 0.639s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-7e344e8b-479d-4226-8383-b2ef6f92ca1c" released by "_delete_snapshot" :: held 3.102s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" released by "delete_snapshot" :: held 3.124s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Created reservations ['8187b441-dda7-4007-99d9-f5fd3c433e98', 'a9f5021c-1e44-4c33-8914-e278f706da0f', 'fd4f80a0-d47b-45f9-91aa-9eb8b5106206', 'a5f6652b-0623-4a58-b225-43612a6244f4'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:21 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Delete snapshot completed successfully. Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-0d908bc6-5a40-4177-9580-4ea9a47dedc2 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-7e344e8b-479d-4226-8383-b2ef6f92ca1c-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:21 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25" returned: 0 in 0.693s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:21 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 is being set with open permissions: ugo+rw Jul 11 18:18:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:21 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 Jul 11 18:18:21 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:22 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25" returned: 0 in 0.620s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:22 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info Jul 11 18:18:22 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2e210f-efcb-4ea7-9eb5-58f09b7da097]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:22 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:18:22 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:23 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info" returned: 0 in 0.642s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:23 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info is being set with open permissions: ugo+rw Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:23 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info Jul 11 18:18:23 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:23 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.773s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:23 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36 Jul 11 18:18:23 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:23 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.info" returned: 0 in 0.643s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.348s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.736s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073301456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a286fa66-bad0-40f1-983a-7a3a86d9eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:17Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Creating volume a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:23 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf 1073741824 Jul 11 18:18:23 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c47a6efa-d237-4700-91a1-6c9c0a637454 tempest-CinderUnicodeTest-1104240593 None] Create snapshot completed successfully Jul 11 18:18:24 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" returned: 0 in 0.649s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36" released by "delete_volume" :: held 1.478s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Created reservations ['fa6a2a83-b6fa-496b-934b-20a3857c5526', '1bbd08c2-af2e-4134-9238-180a0354ff88', '48ce1552-7b2c-4023-8fea-3c1fec752c6e', 'a03b3660-10f2-4953-8a00-d0177fd65d57'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:24 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:24 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-99859ae8-f2a3-4a94-811e-ea5b0248ec25-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-99859ae8-f2a3-4a94-811e-ea5b0248ec25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-quobyte-99859ae8-f2a3-4a94-811e-ea5b0248ec25" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-99859ae8-f2a3-4a94-811e-ea5b0248ec25" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Deleting offline snapshot 99859ae8-f2a3-4a94-811e-ea5b0248ec25 of volume bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] snapshot_file for this snap is: volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[45672603-1845-4b80-a9ec-fa52c356f5bb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:24 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf 1073741824" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:24 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf Jul 11 18:18:24 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:24 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 Jul 11 18:18:24 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:24 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-bc63c853-ad6d-425b-80de-7dad31e563ba-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-bc63c853-ad6d-425b-80de-7dad31e563ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" acquired by "delete_volume" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860e6c8-1a36-4dcf-a7b2-ff4fe20641eb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:25 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.756s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Deleted volume successfully. Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-951d85e1-86e7-45ce-bb16-b2347a50e09f tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-d19d92f2-8fba-49f0-80ec-d43f2c7e1a36-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:25 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba Jul 11 18:18:25 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:25 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf" returned: 0 in 0.730s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.539s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26826cd5-57d4-4182-b7cc-3a8ea97f0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadf88eb-0ef5-44e1-ba07-ad13d109faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:25 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Creating offline snapshot 06b2b1fc-3b2d-480b-a7bb-741f5f154239 of volume 2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25" returned: 0 in 0.853s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b6cc7-66fb-4302-af7b-2a4ab794413b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb961b-30a7-43f3-b984-ef60c16daa3a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Volume volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf (a286fa66-bad0-40f1-983a-7a3a86d9eabf): created successfully Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadf88eb-0ef5-44e1-ba07-ad13d109faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (12b8dce1-6b82-4a94-95d4-2353a654e35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0abc67a7-896a-405c-8802-07938172f7b3 tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:18:25 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 Jul 11 18:18:25 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:25 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f Jul 11 18:18:25 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:25 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba" returned: 0 in 0.816s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:25 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba Jul 11 18:18:25 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:26 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:26 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:26 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 1G Jul 11 18:18:26 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" returned: 0 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:26 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 Jul 11 18:18:26 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:26 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc63c853-ad6d-425b-80de-7dad31e563ba" returned: 0 in 0.665s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-quobyte-bc63c853-ad6d-425b-80de-7dad31e563ba" released by "delete_volume" :: held 1.536s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Created reservations ['70d287f3-a9b4-4506-9e17-801dc9b299a0', '0a62fa1f-dc05-4d04-be2c-1c823aa30335', '94e1e36c-bb5e-4ed6-b4ba-aa096112088a', '7d18d09d-4f78-40fa-b1dc-ee644c261684'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:26 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:26 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:27 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25" returned: 0 in 0.851s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:27 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25 Jul 11 18:18:27 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:27 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 1G" returned: 0 in 0.930s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:27 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 Jul 11 18:18:27 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:27 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.697s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Deleted volume successfully. Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d01b604c-bc74-40e2-a650-f84378f12bc8 tempest-SnapshotDependencyTests-1469042880 None] Lock "cinder-bc63c853-ad6d-425b-80de-7dad31e563ba-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:27 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f.99859ae8-f2a3-4a94-811e-ea5b0248ec25" returned: 0 in 0.729s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-99859ae8-f2a3-4a94-811e-ea5b0248ec25" released by "_delete_snapshot" :: held 3.377s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" released by "delete_snapshot" :: held 3.399s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:28 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239" returned: 0 in 0.800s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:28 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 is being set with open permissions: ugo+rw Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Created reservations ['f84bdae3-6781-4af5-9d28-85e4e037ae52', '0ac683a6-6c5b-47f2-86b5-68f85dff1727', '11011d1e-057d-4208-8e06-6bda7258020e', 'b37922f7-064a-4ac4-bf9e-f52f8c837f79'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:28 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 Jul 11 18:18:28 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:28 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Delete snapshot completed successfully. Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-927285a3-ad3d-48a4-994d-ac695b617591 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-99859ae8-f2a3-4a94-811e-ea5b0248ec25-delete_snapshot" released by "delete_snapshot" :: held 3.603s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:28 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239" returned: 0 in 0.689s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:28 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info Jul 11 18:18:28 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2a4a3-eb0d-4401-ab84-859c6edfb328]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:29 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f Jul 11 18:18:29 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:29 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info" returned: 0 in 0.790s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:29 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info is being set with open permissions: ugo+rw Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:29 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info Jul 11 18:18:29 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:29 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:29 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f Jul 11 18:18:29 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:30 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.info" returned: 0 in 0.838s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.808s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 09bf4180-7145-4474-87c2-5ad73f52308a of volume a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ea592cc2-98c8-42f9-a478-ac899b788df0 tempest-ProjectReaderTests-913399553 None] Create snapshot completed successfully Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79114b-4bd3-447a-96e3-3e33d5d576e5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:30 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f" released by "delete_volume" :: held 1.641s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:30 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf Jul 11 18:18:30 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Created reservations ['7f477658-60b8-4bb6-ae0d-bb6c78d50ca2', 'df89bae4-161d-4d15-a46a-826e092915a4', '2592a448-a54a-4c69-894c-17da546e78bd', 'af44eece-020d-4999-aa97-bdf524f681bf'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:30 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:30 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-c7d681d3-e475-45ca-9737-a00208728e23-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-c7d681d3-e475-45ca-9737-a00208728e23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "cinder-quobyte-c7d681d3-e475-45ca-9737-a00208728e23" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-c7d681d3-e475-45ca-9737-a00208728e23" acquired by "delete_volume" :: waited 0.026s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c012e91-ff7b-4c4d-b0f3-d346d232fc3a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:31 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 Jul 11 18:18:31 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:31 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf" returned: 0 in 1.002s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:31 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a 1G Jul 11 18:18:31 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:31 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.942s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:31 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Deleted volume successfully. Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bfd26245-3edb-4d5e-a9c2-feabb36ac5e5 tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-bc90c004-e8c2-459b-a619-8ccbb0bd2e9f-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-06b2b1fc-3b2d-480b-a7bb-741f5f154239-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-06b2b1fc-3b2d-480b-a7bb-741f5f154239-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-06b2b1fc-3b2d-480b-a7bb-741f5f154239" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-06b2b1fc-3b2d-480b-a7bb-741f5f154239" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Deleting offline snapshot 06b2b1fc-3b2d-480b-a7bb-741f5f154239 of volume 2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] snapshot_file for this snap is: volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27fbb2-9d7e-41e2-a980-208227f9d3b0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:31 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 Jul 11 18:18:31 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:32 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23" returned: 0 in 1.007s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:32 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23 Jul 11 18:18:32 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:32 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a 1G" returned: 0 in 1.063s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:32 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a Jul 11 18:18:32 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:32 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239" returned: 0 in 0.908s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5126387e-2df1-46b5-9524-a0e1715f0f78]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:32 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 Jul 11 18:18:32 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:33 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c7d681d3-e475-45ca-9737-a00208728e23" returned: 0 in 0.746s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-quobyte-c7d681d3-e475-45ca-9737-a00208728e23" released by "delete_volume" :: held 1.826s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Created reservations ['5b375f74-e424-4fd4-b562-c7b2aa74bcaf', '21b18839-2618-4304-aaad-bc0e4030057f', 'fcd40da8-f458-4ac5-be85-ef019c446f43', 'a3db3df5-c5a9-4d44-b0e3-01a4940e4329'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:33 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:33 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:33 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:33 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a is being set with open permissions: ugo+rw Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:33 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a Jul 11 18:18:33 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:33 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" returned: 0 in 0.999s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:33 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 Jul 11 18:18:33 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:34 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.956s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:34 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Deleted volume successfully. Jul 11 18:18:34 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3d7da5d-447f-466f-95dd-8e9516e5f07a tempest-CinderUnicodeTest-1104240593 None] Lock "cinder-c7d681d3-e475-45ca-9737-a00208728e23-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:34 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a" returned: 0 in 0.888s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=161,cinder:SELECT=124,cinder:INSERT=45,cinder:DELETE=13 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:34 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info Jul 11 18:18:34 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.808s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:18:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:18:35 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239" returned: 0 in 1.279s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:35 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239 Jul 11 18:18:35 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:35 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info" returned: 0 in 0.951s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:35 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info is being set with open permissions: ugo+rw Jul 11 18:18:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:35 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info Jul 11 18:18:35 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:36 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721.06b2b1fc-3b2d-480b-a7bb-741f5f154239" returned: 0 in 1.023s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-06b2b1fc-3b2d-480b-a7bb-741f5f154239" released by "_delete_snapshot" :: held 4.373s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:36 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.info" returned: 0 in 0.864s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.780s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" released by "delete_snapshot" :: held 4.441s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9f8dfc8a-877f-4b3b-8c1c-42090ce86800 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Created reservations ['20fd6eb9-3c33-406c-94f6-6e422a815761', 'ed817731-5386-4abe-8eec-ccbd139893f2', '2266edcd-db63-4721-a01f-1d7324e1f54c', '76aab8a7-31be-4ee4-8554-08e971e65c1b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:36 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Delete snapshot completed successfully. Jul 11 18:18:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-30978901-c77b-4510-8594-6de6611f5fc5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-06b2b1fc-3b2d-480b-a7bb-741f5f154239-delete_snapshot" released by "delete_snapshot" :: held 4.615s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-2ea4314a-a6ae-43e0-bcd1-c7c490f90721-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-2ea4314a-a6ae-43e0-bcd1-c7c490f90721-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-09bf4180-7145-4474-87c2-5ad73f52308a-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-09bf4180-7145-4474-87c2-5ad73f52308a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-09bf4180-7145-4474-87c2-5ad73f52308a" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-09bf4180-7145-4474-87c2-5ad73f52308a" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 09bf4180-7145-4474-87c2-5ad73f52308a of volume a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b396de-1803-423e-a489-ca8634c9d928]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3522003-8204-4849-a0ed-dadd0d091a4f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:37 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 Jul 11 18:18:37 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a Jul 11 18:18:37 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:37 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:38 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" returned: 0 in 0.899s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:38 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a" returned: 0 in 0.907s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:38 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721 Jul 11 18:18:38 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde97ec1-4080-427f-b95b-4e11bd63e834]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:38 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf Jul 11 18:18:38 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:39 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" returned: 0 in 0.784s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-2ea4314a-a6ae-43e0-bcd1-c7c490f90721" released by "delete_volume" :: held 1.792s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Created reservations ['0cf7d333-cd2b-41bd-8653-3043b5c56112', '41cc9096-bbae-4c63-a9d8-867e72938014', '09be7533-e727-4be8-8745-33a693f8c17f', '07e67934-a13c-4f03-a350-ae0aa6aca9a8'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:39 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:39 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:39 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf" returned: 0 in 0.881s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:39 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a Jul 11 18:18:39 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:39 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.784s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:39 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:39 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Deleted volume successfully. Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e9f4ba30-ab00-42eb-8476-d6ee9204a6c5 tempest-ProjectReaderTests-913399553 None] Lock "cinder-2ea4314a-a6ae-43e0-bcd1-c7c490f90721-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (3679912d-293b-4767-a398-ba9dfd81ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6195500-fa4e-4104-8e2a-d39e15edb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6195500-fa4e-4104-8e2a-d39e15edb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533946958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf99df3-b2e5-424f-8de8-949c9b1c8b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:40Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0c0f76-5851-4e1b-bcee-7d6b85800e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:40 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0c0f76-5851-4e1b-bcee-7d6b85800e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb670e-7de1-44ba-a0ee-2f1f9200f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb670e-7de1-44ba-a0ee-2f1f9200f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf99df3-b2e5-424f-8de8-949c9b1c8b33', 'volume_name': 'volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16919fb7-7b50-4d24-be22-618447d83ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16919fb7-7b50-4d24-be22-618447d83ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cc40e-390b-46dc-815e-c8bdd1cae5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:40 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Volume bdf99df3-b2e5-424f-8de8-949c9b1c8b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33', 'volume_size': 1} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533946958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf99df3-b2e5-424f-8de8-949c9b1c8b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:40Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Creating volume bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:40 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a" returned: 0 in 0.927s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:40 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 1073741824 Jul 11 18:18:40 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:40 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a Jul 11 18:18:40 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:40 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf.09bf4180-7145-4474-87c2-5ad73f52308a" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-09bf4180-7145-4474-87c2-5ad73f52308a" released by "_delete_snapshot" :: held 3.581s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:40 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" released by "delete_snapshot" :: held 3.652s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Created reservations ['165df87f-0bbf-41bf-b88b-c3e74e4acd5c', 'f921442c-9d2e-44ed-b725-b9dc768e3f32', 'acdbbe43-a0a7-4d3a-b812-eab39b570f09', '9c6fd536-5ced-41d2-bffc-721db9e9f046'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:41 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 1073741824" returned: 0 in 0.941s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e3346590-2223-4100-b01f-7cd5b0c1056e tempest-ProjectMemberTests-377075098 None] Lock "cinder-09bf4180-7145-4474-87c2-5ad73f52308a-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:41 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 Jul 11 18:18:41 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-a286fa66-bad0-40f1-983a-7a3a86d9eabf-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "cinder-a286fa66-bad0-40f1-983a-7a3a86d9eabf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ef2f8-116e-47fb-8598-4c27952531fa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:41 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf Jul 11 18:18:41 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:41 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" returned: 0 in 0.788s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cc40e-390b-46dc-815e-c8bdd1cae5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020bdff7-5c6b-4f66-aa45-a07a4f10595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:41 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Volume volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 (bdf99df3-b2e5-424f-8de8-949c9b1c8b33): created successfully Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020bdff7-5c6b-4f66-aa45-a07a4f10595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:41 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (3679912d-293b-4767-a398-ba9dfd81ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:42 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-42b70c28-5dc7-4e6b-94cc-6b1c9f66a31d tempest-ProjectReaderTests-913399553 None] Created volume successfully. Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Creating offline snapshot 4319e9f8-fbcd-47f7-a087-72cde3de728f of volume bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c12346-c1e4-4e98-85d5-7b37e6c93ac1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:42 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:42 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf" returned: 0 in 0.874s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:42 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:42 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf Jul 11 18:18:42 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:43 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:43 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a286fa66-bad0-40f1-983a-7a3a86d9eabf" returned: 0 in 0.730s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" returned: 0 in 0.868s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a286fa66-bad0-40f1-983a-7a3a86d9eabf" released by "delete_volume" :: held 1.676s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:43 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f 1G Jul 11 18:18:43 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Created reservations ['ec32b99a-7b58-495b-a7b6-e49d31ebe50a', '6c9f023a-4ee6-4602-a843-4259136e5a35', '5f68ddf2-bca5-48ec-a379-2ef077cb2732', 'b6e84be6-14f2-4fb2-9b85-99151482567e'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:43 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:43 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:44 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.770s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:44 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f 1G" returned: 0 in 0.938s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:44 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f Jul 11 18:18:44 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-8cba1c97-9e09-4e38-ba34-4f01b496e582 tempest-ProjectMemberTests-377075098 None] Lock "cinder-a286fa66-bad0-40f1-983a-7a3a86d9eabf-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (7a381648-91b6-43c5-933b-97ef97273d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f70dda-7eec-4311-879f-2d81f49177c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f70dda-7eec-4311-879f-2d81f49177c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795479216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e28f214-d1e2-42be-80d0-c14f314113bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:44Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8ecedb-e379-4e7f-af22-8479a110ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8ecedb-e379-4e7f-af22-8479a110ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b28ae3-62e3-46b2-b1ba-fc5d660a8f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b28ae3-62e3-46b2-b1ba-fc5d660a8f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e28f214-d1e2-42be-80d0-c14f314113bd', 'volume_name': 'volume-2e28f214-d1e2-42be-80d0-c14f314113bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59c2312-2bfb-4c22-8024-a0054937af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59c2312-2bfb-4c22-8024-a0054937af1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d38f93-1859-4d8d-afed-53b851b1a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:44 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Volume 2e28f214-d1e2-42be-80d0-c14f314113bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e28f214-d1e2-42be-80d0-c14f314113bd', 'volume_size': 1} Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:44 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f" returned: 0 in 0.706s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:44 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f is being set with open permissions: ugo+rw Jul 11 18:18:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:44 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f Jul 11 18:18:44 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:45 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:45 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info Jul 11 18:18:45 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:46 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info" returned: 0 in 0.701s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:46 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info is being set with open permissions: ugo+rw Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:46 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info Jul 11 18:18:46 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:46 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.info" returned: 0 in 0.688s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.617s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795479216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e28f214-d1e2-42be-80d0-c14f314113bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:44Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Creating volume 2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:46 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:47 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd 1073741824 Jul 11 18:18:47 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:47 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-47b99cfa-2e4e-44c1-8af9-75ec90bc5b49 tempest-ProjectReaderTests-913399553 None] Create snapshot completed successfully Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-4319e9f8-fbcd-47f7-a087-72cde3de728f-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-4319e9f8-fbcd-47f7-a087-72cde3de728f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-4319e9f8-fbcd-47f7-a087-72cde3de728f" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-4319e9f8-fbcd-47f7-a087-72cde3de728f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Deleting offline snapshot 4319e9f8-fbcd-47f7-a087-72cde3de728f of volume bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] snapshot_file for this snap is: volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51fa87e-5453-441e-8029-e55bc94e5968]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:47 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f Jul 11 18:18:47 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:47 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd 1073741824" returned: 0 in 0.939s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:47 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd Jul 11 18:18:47 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:48 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f" returned: 0 in 0.912s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e20a6-3f02-4a39-a20c-59d19d4e5028]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:48 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd" returned: 0 in 0.737s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d38f93-1859-4d8d-afed-53b851b1a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e28f214-d1e2-42be-80d0-c14f314113bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b90e96-bd89-4971-8eb1-8613b765ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:48 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Volume volume-2e28f214-d1e2-42be-80d0-c14f314113bd (2e28f214-d1e2-42be-80d0-c14f314113bd): created successfully Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b90e96-bd89-4971-8eb1-8613b765ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:48 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 Jul 11 18:18:48 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:48 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (7a381648-91b6-43c5-933b-97ef97273d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:48 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9c64495f-0a37-4711-9f3d-547df499d160 tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:18:49 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" returned: 0 in 0.864s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:49 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f Jul 11 18:18:49 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 89971f76-8359-4759-a6f1-8ccd7fd77e37 of volume 2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c2b18-6ce7-4e9c-b8a6-305ee5811158]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:49 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd Jul 11 18:18:49 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:50 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f" returned: 0 in 0.918s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:50 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f Jul 11 18:18:50 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd" returned: 0 in 0.845s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:50 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 1G Jul 11 18:18:50 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:51 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33.4319e9f8-fbcd-47f7-a087-72cde3de728f" returned: 0 in 0.721s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-4319e9f8-fbcd-47f7-a087-72cde3de728f" released by "_delete_snapshot" :: held 3.534s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" released by "delete_snapshot" :: held 3.561s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Created reservations ['0ac7836c-0e87-4ad0-875d-573edee0fb4c', '35a31aec-838a-4cfd-ae4e-4d71a5e8a848', 'b98a3251-4b1c-471a-b425-c17894314c78', 'ae6799c6-1bc8-4db8-be1c-c9f0d1fef79d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Delete snapshot completed successfully. Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-e8a1093f-5a59-4120-9e07-e40288445802 tempest-ProjectReaderTests-913399553 None] Lock "cinder-4319e9f8-fbcd-47f7-a087-72cde3de728f-delete_snapshot" released by "delete_snapshot" :: held 3.708s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:51 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 1G" returned: 0 in 0.869s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e28f214-d1e2-42be-80d0-c14f314113bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:51 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e28f214-d1e2-42be-80d0-c14f314113bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 Jul 11 18:18:51 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-bdf99df3-b2e5-424f-8de8-949c9b1c8b33-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "cinder-bdf99df3-b2e5-424f-8de8-949c9b1c8b33-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[52822137-6633-4a32-a8d7-16dfb2da6b64]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:52 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 Jul 11 18:18:52 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:52 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e28f214-d1e2-42be-80d0-c14f314113bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37" returned: 0 in 0.718s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:52 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 is being set with open permissions: ugo+rw Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:52 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 Jul 11 18:18:52 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:52 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:52 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37" returned: 0 in 0.629s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:52 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33 Jul 11 18:18:52 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:52 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info Jul 11 18:18:52 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:53 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" returned: 0 in 0.686s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-bdf99df3-b2e5-424f-8de8-949c9b1c8b33" released by "delete_volume" :: held 1.529s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Created reservations ['2d21e8f4-5430-4131-861e-e02c16ce504a', '1138f966-4f87-47ae-aaad-cc43550e6744', 'd7d1a521-3ae7-443c-8fe5-c92a3671b596', 'bd0e7345-96e5-43bf-839c-8b779887c14b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:53 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:53 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info is being set with open permissions: ugo+rw Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:53 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info Jul 11 18:18:53 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:53 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:18:53 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:54 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.info" returned: 0 in 0.760s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.677s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6071d209-ce6c-47e6-ab4d-1973d713b251 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:18:54 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.785s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:18:54 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Deleted volume successfully. Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2c73ca03-295d-48e4-9e9f-823420bd052e tempest-ProjectReaderTests-913399553 None] Lock "cinder-bdf99df3-b2e5-424f-8de8-949c9b1c8b33-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (ddbeb854-9d5a-4d90-827e-f5ed6c5101d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964caa28-778e-4cb1-b1b3-226acdb4867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964caa28-778e-4cb1-b1b3-226acdb4867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473769793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2c5b1d-7270-4722-a9a9-7209992b12bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:55Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f597901e-58f5-43c4-b4b0-2f7b5a096c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f597901e-58f5-43c4-b4b0-2f7b5a096c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372bb392-bebe-4950-8fe6-ff43c547e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372bb392-bebe-4950-8fe6-ff43c547e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2c5b1d-7270-4722-a9a9-7209992b12bd', 'volume_name': 'volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a429192-bf4c-4b59-bcc8-1ea9d43e29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a429192-bf4c-4b59-bcc8-1ea9d43e29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d599d-f565-4b90-a5ad-48c3b0b8a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:54 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Volume fe2c5b1d-7270-4722-a9a9-7209992b12bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd', 'volume_size': 1} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473769793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2c5b1d-7270-4722-a9a9-7209992b12bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:18:55Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Creating volume fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:18:54 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:54 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd 1073741824 Jul 11 18:18:54 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-89971f76-8359-4759-a6f1-8ccd7fd77e37-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-89971f76-8359-4759-a6f1-8ccd7fd77e37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:54 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-89971f76-8359-4759-a6f1-8ccd7fd77e37" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-89971f76-8359-4759-a6f1-8ccd7fd77e37" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 89971f76-8359-4759-a6f1-8ccd7fd77e37 of volume 2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2409bb8-8cd6-493e-89e9-6176c79438c6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:55 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 Jul 11 18:18:55 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:55 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd 1073741824" returned: 0 in 0.921s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:55 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd Jul 11 18:18:55 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:55 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e28f214-d1e2-42be-80d0-c14f314113bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7835c26-6c14-4881-a72c-5897429e78e1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:56 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd Jul 11 18:18:56 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:56 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd" returned: 0 in 0.680s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d599d-f565-4b90-a5ad-48c3b0b8a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09dddf9-60c5-435b-a2f8-507a30f44e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:18:56 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Volume volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd (fe2c5b1d-7270-4722-a9a9-7209992b12bd): created successfully Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09dddf9-60c5-435b-a2f8-507a30f44e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (ddbeb854-9d5a-4d90-827e-f5ed6c5101d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:18:56 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-78e11bd3-f7ab-4670-be40-5d2ab5a4e352 tempest-ProjectReaderTests-913399553 None] Created volume successfully. Jul 11 18:18:56 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:56 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 Jul 11 18:18:56 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Creating offline snapshot 71664066-bc17-4cd4-a9dc-54cacc9920fe of volume fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8fe41-d185-4f8d-8be0-791a606feea2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:57 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd Jul 11 18:18:57 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:57 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37" returned: 0 in 0.765s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:57 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37 Jul 11 18:18:57 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:57 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:57 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe 1G Jul 11 18:18:57 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:58 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd.89971f76-8359-4759-a6f1-8ccd7fd77e37" returned: 0 in 0.661s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-89971f76-8359-4759-a6f1-8ccd7fd77e37" released by "_delete_snapshot" :: held 3.120s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" released by "delete_snapshot" :: held 3.159s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Created reservations ['6308136a-b25e-4ef7-9d6d-9009698d1dbd', '7c8e30d8-b322-416a-bf57-0cbe61360409', 'e1c80e71-73e8-4065-ae04-9cf4306191aa', '5abb0e4b-649a-421e-a9be-3381d61812b3'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:18:58 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-3ca8ec1f-94c7-4fdb-b8ff-5b8d805ea964 tempest-ProjectMemberTests-377075098 None] Lock "cinder-89971f76-8359-4759-a6f1-8ccd7fd77e37-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:18:58 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe 1G" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:58 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe Jul 11 18:18:58 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-2e28f214-d1e2-42be-80d0-c14f314113bd-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "cinder-2e28f214-d1e2-42be-80d0-c14f314113bd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:59 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe" returned: 0 in 0.696s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:59 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe is being set with open permissions: ugo+rw Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:59 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe Jul 11 18:18:59 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cf45c-a1d3-46e2-991c-7e05a502de0d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:18:59 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd Jul 11 18:18:59 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:18:59 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe" returned: 0 in 0.697s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:18:59 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:00 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info Jul 11 18:19:00 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:00 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd" returned: 0 in 0.758s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:00 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd Jul 11 18:19:00 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:00 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info" returned: 0 in 0.678s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:00 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info is being set with open permissions: ugo+rw Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:00 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info Jul 11 18:19:00 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:00 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-2e28f214-d1e2-42be-80d0-c14f314113bd" returned: 0 in 0.652s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-2e28f214-d1e2-42be-80d0-c14f314113bd" released by "delete_volume" :: held 1.494s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Created reservations ['2bd58d9d-8bb3-456f-9c65-5e17afa32dfd', '02291024-7ec2-40f6-8919-952180f6cd19', '26d90bce-aab2-47d1-9188-0900b3d2e8ea', '88aaa95b-e299-450e-b2a7-461b4f91f553'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:00 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:00 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:00 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:01 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.info" returned: 0 in 0.665s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e349a4f4-3b21-482a-b7ea-f0cbc2d21002 tempest-ProjectReaderTests-913399553 None] Create snapshot completed successfully Jul 11 18:19:01 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.656s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:01 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-bd838164-fc49-46f3-8991-1f7c93799cd1 tempest-ProjectMemberTests-377075098 None] Lock "cinder-2e28f214-d1e2-42be-80d0-c14f314113bd-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (dff4abe4-3c15-4b22-af2a-9eb540d071b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc352a43-fc57-4999-b021-80c8cd355f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc352a43-fc57-4999-b021-80c8cd355f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191220697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e731d5c-ec6c-42b0-af32-27e09bb8b04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:02Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282b0e63-d134-4aa5-96a4-1f6e69b28c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282b0e63-d134-4aa5-96a4-1f6e69b28c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ff4d67-bedb-4192-aa91-ba198410890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ff4d67-bedb-4192-aa91-ba198410890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e731d5c-ec6c-42b0-af32-27e09bb8b04a', 'volume_name': 'volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acca65a6-5b97-418a-951d-b539fed428c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acca65a6-5b97-418a-951d-b539fed428c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a66c1dd-999b-471c-a2ed-d1f879b1d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:01 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Volume 1e731d5c-ec6c-42b0-af32-27e09bb8b04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a', 'volume_size': 1} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191220697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e731d5c-ec6c-42b0-af32-27e09bb8b04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:02Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Creating volume 1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:01 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:01 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:01 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a 1073741824 Jul 11 18:19:01 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-71664066-bc17-4cd4-a9dc-54cacc9920fe-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-71664066-bc17-4cd4-a9dc-54cacc9920fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-71664066-bc17-4cd4-a9dc-54cacc9920fe" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-71664066-bc17-4cd4-a9dc-54cacc9920fe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Deleting offline snapshot 71664066-bc17-4cd4-a9dc-54cacc9920fe of volume fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] snapshot_file for this snap is: volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd970c-89db-492a-b6f3-c6ea5a0b8b83]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:02 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe Jul 11 18:19:02 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:02 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a 1073741824" returned: 0 in 0.835s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:02 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a Jul 11 18:19:02 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:03 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe" returned: 0 in 0.829s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae53933e-369c-4a71-8952-b6887446d7ca]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:03 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd Jul 11 18:19:03 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:03 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" returned: 0 in 0.674s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a66c1dd-999b-471c-a2ed-d1f879b1d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f8f1c-f6fa-4f51-9c17-aebe11ddad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Volume volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a (1e731d5c-ec6c-42b0-af32-27e09bb8b04a): created successfully Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f8f1c-f6fa-4f51-9c17-aebe11ddad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (dff4abe4-3c15-4b22-af2a-9eb540d071b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c5e1d382-cbfe-4d0a-a290-5b9f979409f8 tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:19:03 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd" returned: 0 in 0.780s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:03 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe Jul 11 18:19:03 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 633c8763-7b67-4f25-8ce1-bf0231c6050a of volume 1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f5f68-9234-46c3-a35a-4e4fc5a6c1fd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:04 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a Jul 11 18:19:04 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:04 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe" returned: 0 in 0.719s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:04 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe Jul 11 18:19:04 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:04 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" returned: 0 in 0.799s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:05 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a 1G Jul 11 18:19:05 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:05 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd.71664066-bc17-4cd4-a9dc-54cacc9920fe" returned: 0 in 0.674s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-71664066-bc17-4cd4-a9dc-54cacc9920fe" released by "_delete_snapshot" :: held 3.095s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" released by "delete_snapshot" :: held 3.120s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=116,cinder:UPDATE=147,cinder:DELETE=12,cinder:INSERT=32 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Created reservations ['5eede7a7-2fed-4000-a2ac-75d787bfd82f', '58001737-00b3-445f-ad2a-c5758de38ed3', 'aec887cc-8c9d-4f98-9439-5de140f298c0', 'c6097eec-bddd-454f-a030-fdc59427432d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:05 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Delete snapshot completed successfully. Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-960b7303-0532-4ccc-9cbf-1e6966f4f603 tempest-ProjectReaderTests-913399553 None] Lock "cinder-71664066-bc17-4cd4-a9dc-54cacc9920fe-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:05 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a 1G" returned: 0 in 0.778s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:05 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a Jul 11 18:19:05 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:06 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a" returned: 0 in 0.668s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:06 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a is being set with open permissions: ugo+rw Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-fe2c5b1d-7270-4722-a9a9-7209992b12bd-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:06 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a Jul 11 18:19:06 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "cinder-fe2c5b1d-7270-4722-a9a9-7209992b12bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3a2a78-81a5-4d14-89cf-62a767e6f918]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:06 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd Jul 11 18:19:06 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:07 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a" returned: 0 in 0.640s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:07 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info Jul 11 18:19:07 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:07 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd" returned: 0 in 0.771s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:07 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd Jul 11 18:19:07 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:07 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info" returned: 0 in 0.665s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:07 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info is being set with open permissions: ugo+rw Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:07 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info Jul 11 18:19:07 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:07 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-fe2c5b1d-7270-4722-a9a9-7209992b12bd" returned: 0 in 0.637s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-fe2c5b1d-7270-4722-a9a9-7209992b12bd" released by "delete_volume" :: held 1.470s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Created reservations ['5a3d7e9f-208c-4d92-be51-470fac8885c7', '40fd086c-12ad-4b1e-8c6f-693241a72641', '775d4fd3-2b32-41cb-84c9-56ce90c1fbb6', 'e26d28e5-66e0-4089-8554-4799a833964f'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:08 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:08 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:08 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.info" returned: 0 in 0.628s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.264s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2968ac03-e649-4ebd-8ba5-a4a459c3931a tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:19:08 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.632s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Deleted volume successfully. Jul 11 18:19:08 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-fedbaa47-0c07-4560-854c-02de267516c7 tempest-ProjectReaderTests-913399553 None] Lock "cinder-fe2c5b1d-7270-4722-a9a9-7209992b12bd-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (8ddbbdf0-fa82-4a3b-ab88-b3a857f9dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491fdf5b-e45e-45a8-9927-08512f0b78bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491fdf5b-e45e-45a8-9927-08512f0b78bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917477818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643995f-d144-4fc2-9a60-793213b4798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:09Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d96bb31-5ab3-427c-a161-05aad4711777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d96bb31-5ab3-427c-a161-05aad4711777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4563039-480e-4b09-bc6a-8a059b3a4dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4563039-480e-4b09-bc6a-8a059b3a4dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9643995f-d144-4fc2-9a60-793213b4798c', 'volume_name': 'volume-9643995f-d144-4fc2-9a60-793213b4798c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876208d3-dd97-4824-9754-7330bc4a0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876208d3-dd97-4824-9754-7330bc4a0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b9fe79-5c97-4620-97e2-4c9b5a542055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:09 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Volume 9643995f-d144-4fc2-9a60-793213b4798c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9643995f-d144-4fc2-9a60-793213b4798c', 'volume_size': 1} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917477818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643995f-d144-4fc2-9a60-793213b4798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:09Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Creating volume 9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:09 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:09 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c 1073741824 Jul 11 18:19:09 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-633c8763-7b67-4f25-8ce1-bf0231c6050a-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-633c8763-7b67-4f25-8ce1-bf0231c6050a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-633c8763-7b67-4f25-8ce1-bf0231c6050a" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-633c8763-7b67-4f25-8ce1-bf0231c6050a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 633c8763-7b67-4f25-8ce1-bf0231c6050a of volume 1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16cf3e8-000b-4fe1-a91b-309e3d03d649]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:09 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a Jul 11 18:19:09 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:09 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c 1073741824" returned: 0 in 0.819s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:10 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c Jul 11 18:19:10 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:10 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a" returned: 0 in 0.767s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec0ab8-bf51-445c-90e7-69947a0f3198]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:10 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a Jul 11 18:19:10 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:10 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c" returned: 0 in 0.654s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b9fe79-5c97-4620-97e2-4c9b5a542055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9643995f-d144-4fc2-9a60-793213b4798c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9867e540-7615-44a2-9690-0c143553caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:10 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Volume volume-9643995f-d144-4fc2-9a60-793213b4798c (9643995f-d144-4fc2-9a60-793213b4798c): created successfully Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9867e540-7615-44a2-9690-0c143553caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:10 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (8ddbbdf0-fa82-4a3b-ab88-b3a857f9dd78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:10 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-7c5fa924-fb61-459c-86b0-e479eaefdc33 tempest-ProjectReaderTests-913399553 None] Created volume successfully. Jul 11 18:19:11 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" returned: 0 in 0.777s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:11 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a Jul 11 18:19:11 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Creating offline snapshot 55a43df3-373a-47e5-82e5-626b63de967d of volume 9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6034d2e-d0cb-414f-90a9-3ef3b2f3e5f1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:11 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c Jul 11 18:19:11 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:11 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a" returned: 0 in 0.745s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:11 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a Jul 11 18:19:11 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:12 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c" returned: 0 in 0.771s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:12 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d 1G Jul 11 18:19:12 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:12 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a.633c8763-7b67-4f25-8ce1-bf0231c6050a" returned: 0 in 0.616s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-633c8763-7b67-4f25-8ce1-bf0231c6050a" released by "_delete_snapshot" :: held 3.008s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" released by "delete_snapshot" :: held 3.035s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Created reservations ['b7c2a51c-4a43-4b86-b138-3492bb1d5b95', 'ce761d40-66da-45da-b47f-e400de570f4c', '1120ee00-1657-4a50-8a08-4f2323b560f2', '34177666-913a-435e-b5dc-78c77e2e22ce'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:12 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-66e81ee3-6432-4f0b-946c-594d863d829d tempest-ProjectMemberTests-377075098 None] Lock "cinder-633c8763-7b67-4f25-8ce1-bf0231c6050a-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:12 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d 1G" returned: 0 in 0.802s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:12 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9643995f-d144-4fc2-9a60-793213b4798c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:12 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9643995f-d144-4fc2-9a60-793213b4798c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d Jul 11 18:19:12 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-1e731d5c-ec6c-42b0-af32-27e09bb8b04a-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:13 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9643995f-d144-4fc2-9a60-793213b4798c -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:13 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d is being set with open permissions: ugo+rw Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "cinder-1e731d5c-ec6c-42b0-af32-27e09bb8b04a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:13 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d Jul 11 18:19:13 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d9a28-0daf-4ddc-aaf7-98ba8641c25c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:13 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:13 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a Jul 11 18:19:13 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:14 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:14 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info Jul 11 18:19:14 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:14 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" returned: 0 in 0.748s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:14 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a Jul 11 18:19:14 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:14 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:14 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info is being set with open permissions: ugo+rw Jul 11 18:19:14 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:14 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info Jul 11 18:19:14 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:15 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" returned: 0 in 0.660s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-1e731d5c-ec6c-42b0-af32-27e09bb8b04a" released by "delete_volume" :: held 1.475s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Created reservations ['aa95398d-b33d-4272-95b5-be4bc08ecbb6', '6319a119-4366-4e0b-a3dd-4e920311f9af', 'e44315d6-cd6c-4411-881a-24b926f66601', '2661f082-56f3-4ff5-b271-d9f249269cbf'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:15 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:15 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:15 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.info" returned: 0 in 0.649s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.268s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c559313a-3c1d-412c-af07-e10f59fa3987 tempest-ProjectReaderTests-913399553 None] Create snapshot completed successfully Jul 11 18:19:15 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:15 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:19:15 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-92f0b107-75a9-41fa-adde-e9c6bfe649e2 tempest-ProjectMemberTests-377075098 None] Lock "cinder-1e731d5c-ec6c-42b0-af32-27e09bb8b04a-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (5e1edb98-d785-41a1-b878-0de23451717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2abef1-38a2-441f-8fff-164d30b49cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2abef1-38a2-441f-8fff-164d30b49cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746645849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedd0973-6d87-4c60-90a0-0f51ccd5fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:16Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb11d95-a891-4f6d-9c16-36862bb0675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb11d95-a891-4f6d-9c16-36862bb0675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f2529b-073b-4387-a68f-3388dd66fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f2529b-073b-4387-a68f-3388dd66fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bedd0973-6d87-4c60-90a0-0f51ccd5fdb0', 'volume_name': 'volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5124e186-564e-418d-b777-084feff93742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5124e186-564e-418d-b777-084feff93742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596d7217-338b-4dd8-a406-6c7ed4ce7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:16 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Volume bedd0973-6d87-4c60-90a0-0f51ccd5fdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0', 'volume_size': 1} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746645849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedd0973-6d87-4c60-90a0-0f51ccd5fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:16Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Creating volume bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:16 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:16 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 1073741824 Jul 11 18:19:16 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-55a43df3-373a-47e5-82e5-626b63de967d-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-55a43df3-373a-47e5-82e5-626b63de967d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-55a43df3-373a-47e5-82e5-626b63de967d" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-55a43df3-373a-47e5-82e5-626b63de967d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Deleting offline snapshot 55a43df3-373a-47e5-82e5-626b63de967d of volume 9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] snapshot_file for this snap is: volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f67b3-ee46-4f2a-8eef-e2579e73a2d5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:16 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:16 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d Jul 11 18:19:16 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:17 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 1073741824" returned: 0 in 0.815s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:17 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 Jul 11 18:19:17 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:17 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d" returned: 0 in 0.779s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9643995f-d144-4fc2-9a60-793213b4798c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab71ca-0806-4f58-a505-345e45c304c1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:17 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c Jul 11 18:19:17 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:17 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596d7217-338b-4dd8-a406-6c7ed4ce7f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa94ffa-e4a9-4852-9640-d891a1649837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:17 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Volume volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 (bedd0973-6d87-4c60-90a0-0f51ccd5fdb0): created successfully Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa94ffa-e4a9-4852-9640-d891a1649837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:17 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (5e1edb98-d785-41a1-b878-0de23451717c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:17 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-c0f5339f-5ec0-4188-9225-bed16301aec5 tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:19:18 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c" returned: 0 in 0.746s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:18 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d Jul 11 18:19:18 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 of volume bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d2358-a4af-418c-8742-1125b908c7a7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:18 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 Jul 11 18:19:18 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:18 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:18 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d Jul 11 18:19:18 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:19 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" returned: 0 in 0.776s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:19 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 1G Jul 11 18:19:19 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:19 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c.55a43df3-373a-47e5-82e5-626b63de967d" returned: 0 in 0.643s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-55a43df3-373a-47e5-82e5-626b63de967d" released by "_delete_snapshot" :: held 3.021s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" released by "delete_snapshot" :: held 3.046s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Created reservations ['c06a46aa-8ec4-4168-8f8a-755d71f8fd32', '10809441-6c16-4ab0-b942-d2c4ac750dec', 'e665eb7f-6832-4ad0-92f0-c27b2b4f7f38', 'e639b706-6fe5-4200-8039-574f4ddb91d7'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:19 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Delete snapshot completed successfully. Jul 11 18:19:19 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-1a4755dd-e741-4ee9-bffa-2b41a8e77f14 tempest-ProjectReaderTests-913399553 None] Lock "cinder-55a43df3-373a-47e5-82e5-626b63de967d-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:20 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 1G" returned: 0 in 0.824s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:20 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 Jul 11 18:19:20 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:20 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-9643995f-d144-4fc2-9a60-793213b4798c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" returned: 0 in 0.694s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:20 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 is being set with open permissions: ugo+rw Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:20 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "cinder-9643995f-d144-4fc2-9a60-793213b4798c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:20 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ae7d5-fd44-4348-bf6a-fff0ecac06e9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:21 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c Jul 11 18:19:21 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:21 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" returned: 0 in 0.631s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:21 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info Jul 11 18:19:21 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:21 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:21 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c Jul 11 18:19:21 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:22 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info" returned: 0 in 0.637s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:22 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info is being set with open permissions: ugo+rw Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:22 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info Jul 11 18:19:22 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:22 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9643995f-d144-4fc2-9a60-793213b4798c" returned: 0 in 0.617s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9643995f-d144-4fc2-9a60-793213b4798c" released by "delete_volume" :: held 1.424s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Created reservations ['00ca5c9b-7c4f-4003-9e55-d9093ac90b5e', 'fdc3bf55-04ff-431e-906b-8e00db993783', '3f941d14-208b-487b-a5d7-7aaa20cdb847', '4523d0eb-f390-4c78-8168-f59c218db29a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:22 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:22 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:22 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.info" returned: 0 in 0.624s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:22 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-e288ca63-fb61-4ad9-97ba-a6579d7aecc0 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:19:23 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.625s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Deleted volume successfully. Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-34952c26-773a-4c32-bb4b-f32fa6ed0671 tempest-ProjectReaderTests-913399553 None] Lock "cinder-9643995f-d144-4fc2-9a60-793213b4798c-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (fe9ef7d9-9b32-4cc6-9939-f42fa3953d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37b27c0-8cc0-480e-be2f-239588dc5e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37b27c0-8cc0-480e-be2f-239588dc5e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257770866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999ad9e-4bb2-43ad-8646-4b28bcbbf220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:23Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b143a8-ecea-4212-9c59-7b126475fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b143a8-ecea-4212-9c59-7b126475fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65efe8cc-59c9-41c0-9da7-3574a9548539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65efe8cc-59c9-41c0-9da7-3574a9548539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9999ad9e-4bb2-43ad-8646-4b28bcbbf220', 'volume_name': 'volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50af3044-c166-48a5-b267-8bebe147c2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50af3044-c166-48a5-b267-8bebe147c2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234f63a4-cbb4-4a4a-ad73-a6d52a0cc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Volume 9999ad9e-4bb2-43ad-8646-4b28bcbbf220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220', 'volume_size': 1} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257770866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999ad9e-4bb2-43ad-8646-4b28bcbbf220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39332ce85b241ab8110e7bbf12ab1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:23Z,use_quota=True,user_id='42e4cedd7a8b4089897a756397a2b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Creating volume 9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:23 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 1073741824 Jul 11 18:19:23 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 of volume bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5250330-6f3b-4ac9-8f4a-bf0ef1e9e8b4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:23 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 Jul 11 18:19:23 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:24 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 1073741824" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:24 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 Jul 11 18:19:24 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:24 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" returned: 0 in 0.765s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a91918-6a82-486a-8c81-dc3deda875e2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:24 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 Jul 11 18:19:24 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:25 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" returned: 0 in 0.658s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234f63a4-cbb4-4a4a-ad73-a6d52a0cc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279f671e-cc46-426b-9f1a-ad129cecedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Volume volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 (9999ad9e-4bb2-43ad-8646-4b28bcbbf220): created successfully Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279f671e-cc46-426b-9f1a-ad129cecedcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Flow 'volume_create_manager' (fe9ef7d9-9b32-4cc6-9939-f42fa3953d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-20e57f43-103e-4a8f-9053-4f0535f94d9f tempest-ProjectReaderTests-913399553 None] Created volume successfully. Jul 11 18:19:25 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" returned: 0 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:25 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 Jul 11 18:19:25 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Creating offline snapshot 593f5390-4a12-493b-89a1-f4aa3a39b3e8 of volume 9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683fc23-0ec6-42dd-bdb8-cd28b52a8063]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:25 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 Jul 11 18:19:25 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:26 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" returned: 0 in 0.755s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:26 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132 Jul 11 18:19:26 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:26 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:26 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 1G Jul 11 18:19:26 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:26 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0.c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" returned: 0 in 0.662s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132" released by "_delete_snapshot" :: held 3.047s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" released by "delete_snapshot" :: held 3.074s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Created reservations ['a8eec343-ca8e-4184-96a2-0a53d5a6d123', '5d88f123-d138-4a7b-8892-db7640e62085', '19e6da09-9ffe-4629-b2b1-1d5e93d2269d', '00bae1b6-01f9-49db-9ba9-4ccdf731532d'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:26 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:19:26 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-2b9a4f48-2af4-43f5-8b33-ddf11615f6a0 tempest-ProjectMemberTests-377075098 None] Lock "cinder-c8ce4fa5-3635-4eb7-8aeb-532fecf9e132-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:27 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 1G" returned: 0 in 0.789s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:27 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 Jul 11 18:19:27 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:27 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8" returned: 0 in 0.670s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:27 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 is being set with open permissions: ugo+rw Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "cinder-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:27 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 Jul 11 18:19:27 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" acquired by "delete_volume" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff4d30-4090-466c-8fd4-bcb69175da4e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:28 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 Jul 11 18:19:28 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:28 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8" returned: 0 in 0.640s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:28 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info Jul 11 18:19:28 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:28 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" returned: 0 in 0.734s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:28 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0 Jul 11 18:19:28 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:29 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info" returned: 0 in 0.637s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:29 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info is being set with open permissions: ugo+rw Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:29 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info Jul 11 18:19:29 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:29 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" returned: 0 in 0.633s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0" released by "delete_volume" :: held 1.424s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Created reservations ['4d4f2eb2-9d74-4096-bbd2-4da5e8722a34', '06aa5263-00a6-4141-b0c0-2d19b3803980', '41b4621a-3f6f-4757-a47e-4a8f0ac94b66', '312d8fc3-c464-4363-881c-0ba0420ef813'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:29 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:29 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:29 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.info" returned: 0 in 0.643s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.218s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-49f44c65-47d0-440d-b2d1-88675da86cf6 tempest-ProjectReaderTests-913399553 None] Create snapshot completed successfully Jul 11 18:19:30 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.657s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:30 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b3012927-92dc-4bde-b0a7-0ff6dbaaa678 tempest-ProjectMemberTests-377075098 None] Lock "cinder-bedd0973-6d87-4c60-90a0-0f51ccd5fdb0-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (c1b033c1-cf7e-4972-99e7-adf1d4ecf2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126a7e29-6066-4ca2-86cc-4b8d0d05ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126a7e29-6066-4ca2-86cc-4b8d0d05ce42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1646907984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c3cd1b-9e27-4938-987b-2d52352640c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:31Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e81e1b3-6ad3-41b5-aa79-f36b37a2774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e81e1b3-6ad3-41b5-aa79-f36b37a2774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42de314-19b3-472f-a7cd-1d72e0e6f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42de314-19b3-472f-a7cd-1d72e0e6f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c3cd1b-9e27-4938-987b-2d52352640c9', 'volume_name': 'volume-18c3cd1b-9e27-4938-987b-2d52352640c9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef117ff-1e8a-4636-b322-e553c877f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef117ff-1e8a-4636-b322-e553c877f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd73b50c-67fc-4511-94b4-3edb71ef9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:30 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Volume 18c3cd1b-9e27-4938-987b-2d52352640c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c3cd1b-9e27-4938-987b-2d52352640c9', 'volume_size': 1} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1646907984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c3cd1b-9e27-4938-987b-2d52352640c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:31Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Creating volume 18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:30 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:30 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 1073741824 Jul 11 18:19:30 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-593f5390-4a12-493b-89a1-f4aa3a39b3e8-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-593f5390-4a12-493b-89a1-f4aa3a39b3e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-593f5390-4a12-493b-89a1-f4aa3a39b3e8" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-593f5390-4a12-493b-89a1-f4aa3a39b3e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Deleting offline snapshot 593f5390-4a12-493b-89a1-f4aa3a39b3e8 of volume 9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] snapshot_file for this snap is: volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[351184db-863b-400e-a4f2-095fb5506e5d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:31 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 Jul 11 18:19:31 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:31 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 1073741824" returned: 0 in 0.794s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:31 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 Jul 11 18:19:31 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:31 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8" returned: 0 in 0.754s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab70c0c-606f-4e20-8cc6-a9d3a6647af4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:31 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 Jul 11 18:19:31 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:32 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9" returned: 0 in 0.642s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd73b50c-67fc-4511-94b4-3edb71ef9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c3cd1b-9e27-4938-987b-2d52352640c9', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce82c4-ba17-40d7-bda8-5faf36946c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:32 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Volume volume-18c3cd1b-9e27-4938-987b-2d52352640c9 (18c3cd1b-9e27-4938-987b-2d52352640c9): created successfully Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce82c4-ba17-40d7-bda8-5faf36946c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (c1b033c1-cf7e-4972-99e7-adf1d4ecf2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-2b76e077-2746-43aa-bfde-2f8f98871d1d tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:19:32 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" returned: 0 in 0.752s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:32 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 Jul 11 18:19:32 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 0665ec39-cabf-4586-ad43-9a76520458c0 of volume 18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb7fe3c-50c6-4568-9142-a699a7135169]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:32 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 Jul 11 18:19:32 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:33 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8" returned: 0 in 0.826s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:33 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8 Jul 11 18:19:33 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:33 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9" returned: 0 in 0.772s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:33 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 1G Jul 11 18:19:33 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:33 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220.593f5390-4a12-493b-89a1-f4aa3a39b3e8" returned: 0 in 0.636s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:33 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-593f5390-4a12-493b-89a1-f4aa3a39b3e8" released by "_delete_snapshot" :: held 3.052s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" released by "delete_snapshot" :: held 3.074s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Created reservations ['8feee850-c445-4a9d-8462-077fc87252c5', '45437c99-3d6c-4592-8d1d-5b699c66e20c', '7bc48d63-b10c-4545-81f5-55f76bbfc5c8', 'eb891e18-4855-4b9f-9437-681e26340424'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Delete snapshot completed successfully. Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-12788ade-c05d-4b37-bfd5-28e80ec0e69a tempest-ProjectReaderTests-913399553 None] Lock "cinder-593f5390-4a12-493b-89a1-f4aa3a39b3e8-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:34 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:34 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:34 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 1G" returned: 0 in 0.782s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c3cd1b-9e27-4938-987b-2d52352640c9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:34 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c3cd1b-9e27-4938-987b-2d52352640c9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 Jul 11 18:19:34 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:34 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.634s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:19:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:19:35 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c3cd1b-9e27-4938-987b-2d52352640c9 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0" returned: 0 in 0.659s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:35 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 is being set with open permissions: ugo+rw Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:35 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 Jul 11 18:19:35 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-9999ad9e-4bb2-43ad-8646-4b28bcbbf220-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "cinder-9999ad9e-4bb2-43ad-8646-4b28bcbbf220-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=119,cinder:DELETE=12,cinder:INSERT=46,cinder:UPDATE=145 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Acquiring lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3f601-fa9c-46d2-9796-648c640f8ef6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:35 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 Jul 11 18:19:35 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:35 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0" returned: 0 in 0.632s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:35 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info Jul 11 18:19:35 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:36 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:36 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220 Jul 11 18:19:36 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:36 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info" returned: 0 in 0.673s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:36 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info is being set with open permissions: ugo+rw Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:36 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info Jul 11 18:19:36 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:36 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" returned: 0 in 0.655s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "cinder-quobyte-9999ad9e-4bb2-43ad-8646-4b28bcbbf220" released by "delete_volume" :: held 1.476s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Created reservations ['d6be5768-0419-460c-b27d-30df79d50382', 'c44060ef-59e7-4e28-b42b-569a8c20b618', '91c47c75-1618-461c-b1f8-0bba9eaef6c5', '7c7838c8-52b8-47af-a330-212c33472034'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:36 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:36 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:37 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.info" returned: 0 in 0.669s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-59814432-2251-454f-ab65-346055564c6c tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:19:37 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.674s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:37 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Deleted volume successfully. Jul 11 18:19:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-94d1ece6-548e-4b23-9b35-a94266a7f8f0 tempest-ProjectReaderTests-913399553 None] Lock "cinder-9999ad9e-4bb2-43ad-8646-4b28bcbbf220-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-0665ec39-cabf-4586-ad43-9a76520458c0-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-0665ec39-cabf-4586-ad43-9a76520458c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-0665ec39-cabf-4586-ad43-9a76520458c0" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-0665ec39-cabf-4586-ad43-9a76520458c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 0665ec39-cabf-4586-ad43-9a76520458c0 of volume 18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb7036-dad2-499b-82c5-c3f6247bd5a0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:38 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 Jul 11 18:19:38 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:38 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0" returned: 0 in 0.805s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18c3cd1b-9e27-4938-987b-2d52352640c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[86122d49-c07b-4917-a0ec-9360c3a0f9cb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:38 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:39 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 Jul 11 18:19:39 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:39 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9" returned: 0 in 0.768s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:39 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:39 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 Jul 11 18:19:39 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:40 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0" returned: 0 in 0.797s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:40 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:40 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0 Jul 11 18:19:40 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:41 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:41 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9.0665ec39-cabf-4586-ad43-9a76520458c0" returned: 0 in 0.649s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-0665ec39-cabf-4586-ad43-9a76520458c0" released by "_delete_snapshot" :: held 3.122s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" released by "delete_snapshot" :: held 3.149s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:41 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Created reservations ['03120adf-da7c-4e3c-9440-1bb2ac2cd6cc', '8a3e7e15-f292-44c3-b7f0-155ed6d56bdf', '17b6c1f5-2799-4027-9761-f7eb09240920', 'c97307bf-56a0-4164-8e11-4bf940560d8a'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:41 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:19:41 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-62912445-8ff3-4705-a700-791b659f2ded tempest-ProjectMemberTests-377075098 None] Lock "cinder-0665ec39-cabf-4586-ad43-9a76520458c0-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-18c3cd1b-9e27-4938-987b-2d52352640c9-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "cinder-18c3cd1b-9e27-4938-987b-2d52352640c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369998d-6d52-4871-bec6-b14b5aa39de0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:42 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:42 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 Jul 11 18:19:42 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:43 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9" returned: 0 in 0.803s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:43 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9 Jul 11 18:19:43 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:43 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-18c3cd1b-9e27-4938-987b-2d52352640c9" returned: 0 in 0.615s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-18c3cd1b-9e27-4938-987b-2d52352640c9" released by "delete_volume" :: held 1.476s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Created reservations ['4df09b3c-476a-44d9-bcb7-587ed13f407a', '3cede53f-e977-47a9-9bb4-7fb90c20cc27', 'f6a6dc28-7e03-4f7e-927d-4ba5b1d835b1', '856bf362-5841-48a2-adc7-e1cd6f5e8bba'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:43 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:43 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:43 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:44 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:44 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.667s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:44 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:44 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:19:44 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-b388c007-89d6-4514-9c87-f758453141b3 tempest-ProjectMemberTests-377075098 None] Lock "cinder-18c3cd1b-9e27-4938-987b-2d52352640c9-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:44 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (25209979-e853-4218-af4a-36fd389d3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d831863-112a-48a8-9463-ed34cff234de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d831863-112a-48a8-9463-ed34cff234de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859178196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165fab9-e179-4700-acdc-a6b4861536a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:45Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93347096-e9d0-4a25-a989-785a4da843d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93347096-e9d0-4a25-a989-785a4da843d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced70cc6-1d2e-44f4-a3b5-8b93b56a06c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced70cc6-1d2e-44f4-a3b5-8b93b56a06c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a165fab9-e179-4700-acdc-a6b4861536a2', 'volume_name': 'volume-a165fab9-e179-4700-acdc-a6b4861536a2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3269604e-1399-4bc4-8864-54bdeede25ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3269604e-1399-4bc4-8864-54bdeede25ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01cced0-85fc-4978-aa2b-f01687690ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:45 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Volume a165fab9-e179-4700-acdc-a6b4861536a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a165fab9-e179-4700-acdc-a6b4861536a2', 'volume_size': 1} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859178196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165fab9-e179-4700-acdc-a6b4861536a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8910c2a0e26041f780f2392653311714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:19:45Z,use_quota=True,user_id='e876b3212cc14ebe976284034eac7f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Creating volume a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:19:45 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:45 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 1073741824 Jul 11 18:19:45 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:45 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 1073741824" returned: 0 in 0.844s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:45 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:45 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 Jul 11 18:19:45 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:46 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2" returned: 0 in 0.672s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01cced0-85fc-4978-aa2b-f01687690ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a165fab9-e179-4700-acdc-a6b4861536a2', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c8bcb6-d15a-4535-9761-52093b4c9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:19:46 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Volume volume-a165fab9-e179-4700-acdc-a6b4861536a2 (a165fab9-e179-4700-acdc-a6b4861536a2): created successfully Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c8bcb6-d15a-4535-9761-52093b4c9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:19:46 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Flow 'volume_create_manager' (25209979-e853-4218-af4a-36fd389d3a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:19:46 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-ffaa5a8b-a09a-4575-8b7f-cde45fe88e0c tempest-ProjectMemberTests-377075098 None] Created volume successfully. Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Creating offline snapshot 0fcc4c26-74bb-41a3-93ed-33a6c121cf36 of volume a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2100271a-4914-47fb-952d-4174492eee65]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:47 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 Jul 11 18:19:47 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:47 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:47 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 1G {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:48 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 1G Jul 11 18:19:48 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:48 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 1G" returned: 0 in 0.826s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:48 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a165fab9-e179-4700-acdc-a6b4861536a2 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:48 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a165fab9-e179-4700-acdc-a6b4861536a2 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 Jul 11 18:19:48 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:49 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a165fab9-e179-4700-acdc-a6b4861536a2 -F qcow2 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36" returned: 0 in 0.715s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:49 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 is being set with open permissions: ugo+rw Jul 11 18:19:49 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:49 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 Jul 11 18:19:49 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:50 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36" returned: 0 in 0.706s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:50 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info Jul 11 18:19:50 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:50 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:50 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info" returned: 0 in 0.724s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:51 devstack cinder-volume[86932]: WARNING cinder.volume.drivers.remotefs [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info is being set with open permissions: ugo+rw Jul 11 18:19:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:51 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info Jul 11 18:19:51 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:51 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.info" returned: 0 in 0.645s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:51 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.481s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:51 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-0ecf80ef-8372-463f-b915-4680816378a3 tempest-ProjectMemberTests-377075098 None] Create snapshot completed successfully Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-0fcc4c26-74bb-41a3-93ed-33a6c121cf36-delete_snapshot" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-0fcc4c26-74bb-41a3-93ed-33a6c121cf36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" by "delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-0fcc4c26-74bb-41a3-93ed-33a6c121cf36" by "_delete_snapshot" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-0fcc4c26-74bb-41a3-93ed-33a6c121cf36" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Deleting offline snapshot 0fcc4c26-74bb-41a3-93ed-33a6c121cf36 of volume a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] snapshot_file for this snap is: volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516f03b-778b-49a6-8234-5952f42c2d4a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:52 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:52 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 Jul 11 18:19:52 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:53 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36" returned: 0 in 0.762s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:53 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a165fab9-e179-4700-acdc-a6b4861536a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86932) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:19:53 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c435580-dccc-4437-89ad-87c02279d7c3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:53 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:53 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 Jul 11 18:19:53 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:54 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2" returned: 0 in 0.806s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:54 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:54 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 Jul 11 18:19:54 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:55 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36" returned: 0 in 0.800s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:55 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36 Jul 11 18:19:55 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:55 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2.0fcc4c26-74bb-41a3-93ed-33a6c121cf36" returned: 0 in 0.692s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-0fcc4c26-74bb-41a3-93ed-33a6c121cf36" released by "_delete_snapshot" :: held 3.164s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" released by "delete_snapshot" :: held 3.188s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Created reservations ['a68ce3bb-83e3-4bc9-82be-c6e150b3a5d0', '59b1bad7-4ebd-4a77-8ce2-400529aefd9e', 'b600478a-c5c9-4ccc-b5d6-57ceb2feba4a', '170ad759-5248-4dfb-84b1-9ce9a7e40fb2'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:55 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Delete snapshot completed successfully. Jul 11 18:19:55 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-99294b9e-df89-440e-9f54-50edbbf9364e tempest-ProjectMemberTests-377075098 None] Lock "cinder-0fcc4c26-74bb-41a3-93ed-33a6c121cf36-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-a165fab9-e179-4700-acdc-a6b4861536a2-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "cinder-a165fab9-e179-4700-acdc-a6b4861536a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Acquiring lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384b454-b657-44f9-8fa2-f3ec4a16dcd4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:19:56 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:56 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 Jul 11 18:19:56 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:57 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2" returned: 0 in 0.757s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:57 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:57 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2 Jul 11 18:19:57 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:58 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-a165fab9-e179-4700-acdc-a6b4861536a2" returned: 0 in 0.623s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "cinder-quobyte-a165fab9-e179-4700-acdc-a6b4861536a2" released by "delete_volume" :: held 1.434s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Created reservations ['ca966802-b7a3-42e5-8e80-849a6a9780f7', 'd907d159-58f8-470e-8c6a-27c079811d34', 'b270840b-fa5a-4be9-b5ba-d352ee731a40', 'c0a4a9ef-7b5c-4f19-904a-3aa0ec5b9c5c'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:19:58 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:19:58 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:19:58 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:19:58 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:19:59 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Deleted volume successfully. Jul 11 18:19:59 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-d861a69b-6145-410b-9cba-ae998bb1e175 tempest-ProjectMemberTests-377075098 None] Lock "cinder-a165fab9-e179-4700-acdc-a6b4861536a2-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Flow 'volume_create_manager' (3b20a1d5-8632-48fd-9c02-a9d65effdb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e9ca74-2e66-4578-affc-99e11019dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e9ca74-2e66-4578-affc-99e11019dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612099960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dc713d-37a2-46d0-835a-42fc2a735e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee750223bd84b5c9cd1d0de31a20142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:02Z,use_quota=True,user_id='a1360eb8ddae47d5a9418981166a162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9271d7f7-1f6b-44ca-a43e-7b133d07fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9271d7f7-1f6b-44ca-a43e-7b133d07fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6311d3-4b6d-44cb-8f10-f7245f2edc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6311d3-4b6d-44cb-8f10-f7245f2edc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4dc713d-37a2-46d0-835a-42fc2a735e24', 'volume_name': 'volume-c4dc713d-37a2-46d0-835a-42fc2a735e24', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52fee28-7805-44f1-9ea5-8431db19f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52fee28-7805-44f1-9ea5-8431db19f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d29ad-f6cf-4e90-abad-6b0359fd2fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:02 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Volume c4dc713d-37a2-46d0-835a-42fc2a735e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4dc713d-37a2-46d0-835a-42fc2a735e24', 'volume_size': 1} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612099960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dc713d-37a2-46d0-835a-42fc2a735e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee750223bd84b5c9cd1d0de31a20142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:02Z,use_quota=True,user_id='a1360eb8ddae47d5a9418981166a162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Creating volume c4dc713d-37a2-46d0-835a-42fc2a735e24 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:02 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:02 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:02 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 1073741824 Jul 11 18:20:02 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:03 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 1073741824" returned: 0 in 0.787s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:03 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 Jul 11 18:20:03 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:03 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24" returned: 0 in 0.607s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d29ad-f6cf-4e90-abad-6b0359fd2fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4dc713d-37a2-46d0-835a-42fc2a735e24', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1eb16f-bf6c-498c-b17b-19095383b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:03 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Volume volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 (c4dc713d-37a2-46d0-835a-42fc2a735e24): created successfully Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1eb16f-bf6c-498c-b17b-19095383b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:03 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Flow 'volume_create_manager' (3b20a1d5-8632-48fd-9c02-a9d65effdb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:03 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-fdb3a9f6-717c-42c3-8411-947cc5f25bc9 tempest-ProjectReaderTests-290664969 None] Created volume successfully. Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Acquiring lock "cinder-c4dc713d-37a2-46d0-835a-42fc2a735e24-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "cinder-c4dc713d-37a2-46d0-835a-42fc2a735e24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Acquiring lock "cinder-quobyte-c4dc713d-37a2-46d0-835a-42fc2a735e24" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "cinder-quobyte-c4dc713d-37a2-46d0-835a-42fc2a735e24" acquired by "delete_volume" :: waited 0.014s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e5129d-ff91-4c4f-9d71-2d0775a69a89]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:04 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:04 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 Jul 11 18:20:04 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:05 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24" returned: 0 in 0.719s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:05 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24 Jul 11 18:20:05 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:05 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-c4dc713d-37a2-46d0-835a-42fc2a735e24" returned: 0 in 0.619s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "cinder-quobyte-c4dc713d-37a2-46d0-835a-42fc2a735e24" released by "delete_volume" :: held 1.375s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:INSERT=32,cinder:UPDATE=127,cinder:SELECT=90,cinder:DELETE=10 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Created reservations ['e9863d7a-797b-4884-b826-e47279056e4a', '7d8c3ada-acd7-4a89-ac3d-c0086ac5f7c1', 'acfd1221-3b75-4333-81b8-f93a754b5b23', '6a6a03d9-fb61-456b-80fd-eeee1d1a2243'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:05 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:06 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:06 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:06 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.624s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:06 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Deleted volume successfully. Jul 11 18:20:06 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-cecad2b8-6b47-443e-b83f-dc1a1fec7b43 tempest-ProjectReaderTests-290664969 None] Lock "cinder-c4dc713d-37a2-46d0-835a-42fc2a735e24-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Flow 'volume_create_manager' (619e6aeb-d1f0-400d-aa7b-d032ae2fb9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea263311-0b40-4f90-b8e0-a999bc6b02a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea263311-0b40-4f90-b8e0-a999bc6b02a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282733440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d37b726-b4ba-4bb3-8232-7dcf97ebea4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee750223bd84b5c9cd1d0de31a20142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:07Z,use_quota=True,user_id='a1360eb8ddae47d5a9418981166a162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13488325-9ab4-4b8d-be3f-2b21df1aa179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13488325-9ab4-4b8d-be3f-2b21df1aa179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9b2514-9b87-4e4c-90b3-3241eb51920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9b2514-9b87-4e4c-90b3-3241eb51920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d37b726-b4ba-4bb3-8232-7dcf97ebea4c', 'volume_name': 'volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9075ca-e44a-420b-a814-5c67db27fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9075ca-e44a-420b-a814-5c67db27fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d485eed2-27d7-47ca-9af3-86de10e9357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:07 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Volume 5d37b726-b4ba-4bb3-8232-7dcf97ebea4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c', 'volume_size': 1} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282733440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d37b726-b4ba-4bb3-8232-7dcf97ebea4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee750223bd84b5c9cd1d0de31a20142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:07Z,use_quota=True,user_id='a1360eb8ddae47d5a9418981166a162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Creating volume 5d37b726-b4ba-4bb3-8232-7dcf97ebea4c {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:07 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:07 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c 1073741824 Jul 11 18:20:07 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:07 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c 1073741824" returned: 0 in 0.772s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:07 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:07 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c Jul 11 18:20:07 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:08 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" returned: 0 in 0.638s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d485eed2-27d7-47ca-9af3-86de10e9357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3e8fd8-8d78-4a53-ae92-c2a836b5f42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:08 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Volume volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c (5d37b726-b4ba-4bb3-8232-7dcf97ebea4c): created successfully Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3e8fd8-8d78-4a53-ae92-c2a836b5f42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:08 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Flow 'volume_create_manager' (619e6aeb-d1f0-400d-aa7b-d032ae2fb9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:08 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-af713292-55d4-4c2c-b877-724de3409fe0 tempest-ProjectReaderTests-290664969 None] Created volume successfully. Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Acquiring lock "cinder-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "cinder-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Acquiring lock "cinder-quobyte-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "cinder-quobyte-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" acquired by "delete_volume" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21cc84e-11c2-4121-857d-7f95fa110c79]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:09 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c Jul 11 18:20:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:09 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" returned: 0 in 0.736s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:09 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:09 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c Jul 11 18:20:09 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:10 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" returned: 0 in 0.624s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "cinder-quobyte-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c" released by "delete_volume" :: held 1.397s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Created reservations ['02ee4255-3374-490d-8e86-3a633fc1df51', 'ca4b4e5a-7e67-4f85-8a5f-2ed49f093b60', '90d5839e-29f7-4b0d-90af-a12a78bb7c87', '1bf5805f-7c61-4ddc-963c-59362ab25682'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:10 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:10 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:10 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:11 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:11 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.619s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:11 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:11 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Deleted volume successfully. Jul 11 18:20:11 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-f5de1b69-5d35-40b5-9c92-73e7e87bb6bd tempest-ProjectReaderTests-290664969 None] Lock "cinder-5d37b726-b4ba-4bb3-8232-7dcf97ebea4c-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (0d15c686-6883-4105-b169-37ce07770304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796806c2-a6fa-4640-bc5a-82886b234821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796806c2-a6fa-4640-bc5a-82886b234821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159739758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:19Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a169bccd-8ebd-4d27-a568-8a676f07f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a169bccd-8ebd-4d27-a568-8a676f07f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b372155-772d-4a38-b8c1-579f20db0fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b372155-772d-4a38-b8c1-579f20db0fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80', 'volume_name': 'volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd185720-737e-4301-9e81-18e2114f2349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd185720-737e-4301-9e81-18e2114f2349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c1a01a-69c8-4aee-8a27-90999f77160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:18 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Volume ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80', 'volume_size': 1} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159739758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:19Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Creating volume ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:18 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:18 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:18 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 1073741824 Jul 11 18:20:18 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:19 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 1073741824" returned: 0 in 0.828s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:19 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:19 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 Jul 11 18:20:19 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:20 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" returned: 0 in 0.632s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c1a01a-69c8-4aee-8a27-90999f77160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8e06e9-e691-49fa-9326-30cee9ba9dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:20 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Volume volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 (ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80): created successfully Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8e06e9-e691-49fa-9326-30cee9ba9dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (0d15c686-6883-4105-b169-37ce07770304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:20 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-9aacad55-c954-4b41-9c91-6c3c8e326547 tempest-ProjectReaderTests-1186008988 None] Created volume successfully. Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:20 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-quobyte-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:21 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:21 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1e7d1-8efd-4e80-a8b4-a1174c042330]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:21 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 Jul 11 18:20:21 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:21 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" returned: 0 in 0.766s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:21 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:21 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80 Jul 11 18:20:21 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:22 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" returned: 0 in 0.654s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80" released by "delete_volume" :: held 1.456s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Created reservations ['59994119-5c83-4581-869a-f058916e0aa9', 'faad1e55-dccd-445d-bbf0-b5dc668d36a8', 'f37bbb5a-09d1-4903-b022-47c1d86e4eb2', '16801c22-e1a7-4b74-8ab9-9e8e77980eef'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:22 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:22 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:22 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:23 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.628s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:23 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Deleted volume successfully. Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-73821bf2-3d21-4cf1-8513-b9f91a954a98 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-ebcd5beb-aa9f-4e50-bb3c-d10932cdfe80-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (ce956835-ac3c-4d76-9692-749608a4cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf91e0-1879-4e88-bc4f-ac4479ab4015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf91e0-1879-4e88-bc4f-ac4479ab4015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779950358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:24Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55bb91d-4910-451e-872f-73b4b2ff042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55bb91d-4910-451e-872f-73b4b2ff042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e05e58-f403-4f8f-abdb-078c14b25426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e05e58-f403-4f8f-abdb-078c14b25426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e', 'volume_name': 'volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91568d59-650f-4b71-9ddc-e6b52e2c9080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91568d59-650f-4b71-9ddc-e6b52e2c9080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75489ab-f0f9-43a9-8202-7c84b77b80d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:23 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Volume 4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e', 'volume_size': 1} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779950358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:24Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Creating volume 4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:23 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:23 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:23 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e 1073741824 Jul 11 18:20:23 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:24 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e 1073741824" returned: 0 in 0.783s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:24 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:24 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e Jul 11 18:20:24 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:25 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" returned: 0 in 0.614s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75489ab-f0f9-43a9-8202-7c84b77b80d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bd68f9-0eb7-43e3-8842-48e4553d3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:25 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Volume volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e (4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e): created successfully Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bd68f9-0eb7-43e3-8842-48e4553d3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (ce956835-ac3c-4d76-9692-749608a4cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:25 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-6c321cf2-9db3-46c5-b36b-dfef32a08e96 tempest-ProjectReaderTests-1186008988 None] Created volume successfully. Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-quobyte-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" acquired by "delete_volume" :: waited 0.013s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2244150f-538a-48f6-9ab3-d9fc8b3494d5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:25 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:25 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e Jul 11 18:20:25 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:26 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" returned: 0 in 0.764s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:26 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:26 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e Jul 11 18:20:26 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:27 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" returned: 0 in 0.622s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e" released by "delete_volume" :: held 1.420s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Created reservations ['56694cb0-8ff3-4eb9-87b8-88faad660646', 'fb5b295d-f7a4-4830-aa4b-af985b3a0a90', 'b0e4dcf6-fe42-4f0e-acaf-b2e6931c9ce7', '49444dcf-1b4a-4247-ac38-efb4cc6c5a4b'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:27 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:27 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:27 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.634s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:27 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Deleted volume successfully. Jul 11 18:20:27 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-af4834e4-3218-4386-9b4f-50df3763fb81 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-4e1b53eb-3c8b-4bc5-a8cc-7b61bd6f5d0e-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (1fdd98be-db67-419d-b992-346cf16dc41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df785d43-7c5e-4eaf-b436-ba2e9f84fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df785d43-7c5e-4eaf-b436-ba2e9f84fa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-748806563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb604013-a522-4b73-b684-ead1764130ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:28Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f234ccf7-d8ee-409b-82de-6b60cc368d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f234ccf7-d8ee-409b-82de-6b60cc368d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b53c341-4361-422f-9ddd-38fe3cf86c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b53c341-4361-422f-9ddd-38fe3cf86c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb604013-a522-4b73-b684-ead1764130ae', 'volume_name': 'volume-bb604013-a522-4b73-b684-ead1764130ae', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3186388-aeb6-4a24-959a-437648c18086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3186388-aeb6-4a24-959a-437648c18086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d1be1e-d5eb-42d4-b018-1947fe824077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:28 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Volume bb604013-a522-4b73-b684-ead1764130ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb604013-a522-4b73-b684-ead1764130ae', 'volume_size': 1} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-748806563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb604013-a522-4b73-b684-ead1764130ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:28Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Creating volume bb604013-a522-4b73-b684-ead1764130ae {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:28 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:28 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:28 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae 1073741824 Jul 11 18:20:28 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:29 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae 1073741824" returned: 0 in 0.800s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:29 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae Jul 11 18:20:29 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:29 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae" returned: 0 in 0.641s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d1be1e-d5eb-42d4-b018-1947fe824077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb604013-a522-4b73-b684-ead1764130ae', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bcd958-1498-46c3-9f60-b114a9b08132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:29 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Volume volume-bb604013-a522-4b73-b684-ead1764130ae (bb604013-a522-4b73-b684-ead1764130ae): created successfully Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bcd958-1498-46c3-9f60-b114a9b08132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:29 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (1fdd98be-db67-419d-b992-346cf16dc41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:29 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-1ea6342c-9225-4850-9cb7-9a34dee4e3ed tempest-ProjectReaderTests-1186008988 None] Created volume successfully. Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-bb604013-a522-4b73-b684-ead1764130ae-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-bb604013-a522-4b73-b684-ead1764130ae-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-quobyte-bb604013-a522-4b73-b684-ead1764130ae" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-bb604013-a522-4b73-b684-ead1764130ae" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a94d79-a7ce-4c7b-a4d9-be14515ece3f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:30 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:30 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae Jul 11 18:20:30 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:31 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae" returned: 0 in 0.741s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:31 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae Jul 11 18:20:31 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:31 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:31 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-bb604013-a522-4b73-b684-ead1764130ae" returned: 0 in 0.639s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:31 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-bb604013-a522-4b73-b684-ead1764130ae" released by "delete_volume" :: held 1.418s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:31 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Created reservations ['8a5f0801-cb3e-440e-92aa-cfc33e392cf8', '08074220-7327-4dae-afe4-72775d70199d', '724d87eb-a2d8-410a-bb76-9d0df2515979', '63033339-d226-453d-963c-efffff3ae960'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:32 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:32 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:32 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.638s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:32 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Deleted volume successfully. Jul 11 18:20:32 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-11402008-8844-450f-9a14-3891c614c4c0 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-bb604013-a522-4b73-b684-ead1764130ae-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.flows.manager.create_volume [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86932) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (2e1ce28c-78f0-48de-bedb-9d4fddd686b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bea3dad-4bf1-4593-afcf-568e97c82a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bea3dad-4bf1-4593-afcf-568e97c82a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901713327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e841daa4-6571-4dab-ac17-94bb944b9a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:33Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed19730-3961-4aab-b34d-b3133356a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed19730-3961-4aab-b34d-b3133356a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69824e68-0641-4da5-a18d-88ab159bb69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69824e68-0641-4da5-a18d-88ab159bb69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e841daa4-6571-4dab-ac17-94bb944b9a00', 'volume_name': 'volume-e841daa4-6571-4dab-ac17-94bb944b9a00', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3770abf-a088-4bfc-b146-e5ab8d6b4a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3770abf-a088-4bfc-b146-e5ab8d6b4a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80f2d52-9e4b-4fc3-adec-d20acc6970e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:33 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Volume e841daa4-6571-4dab-ac17-94bb944b9a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e841daa4-6571-4dab-ac17-94bb944b9a00', 'volume_size': 1} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901713327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e841daa4-6571-4dab-ac17-94bb944b9a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ba140a764f4a259dafd7fb9873e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:20:33Z,use_quota=True,user_id='62cdc44ba4fb44409ccf07c468ecfa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12b33c3-18d3-454d-8efc-cba3f587bb82),volume_type_id=b12b33c3-18d3-454d-8efc-cba3f587bb82)}" {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.remotefs [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Creating volume e841daa4-6571-4dab-ac17-94bb944b9a00 {{(pid=86932) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Selected osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae as target Quobyte volume. {{(pid=86932) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:20:33 devstack cinder-volume[86932]: INFO cinder.volume.drivers.remotefs [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] casted to osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae Jul 11 18:20:33 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 1073741824 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:33 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 1073741824 Jul 11 18:20:33 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:33 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 1073741824" returned: 0 in 0.820s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:34 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 Jul 11 18:20:34 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:34 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:34 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:34 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00" returned: 0 in 0.675s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'} {{(pid=86932) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80f2d52-9e4b-4fc3-adec-d20acc6970e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e841daa4-6571-4dab-ac17-94bb944b9a00', 'volume_size': 1}' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90da2555-5838-481b-b16d-408d70018e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:20:34 devstack cinder-volume[86932]: INFO cinder.volume.flows.manager.create_volume [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Volume volume-e841daa4-6571-4dab-ac17-94bb944b9a00 (e841daa4-6571-4dab-ac17-94bb944b9a00): created successfully Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90da2555-5838-481b-b16d-408d70018e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86932) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Flow 'volume_create_manager' (2e1ce28c-78f0-48de-bedb-9d4fddd686b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86932) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:20:34 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-759393a2-2456-4c4f-830a-1991f87d02e4 tempest-ProjectReaderTests-1186008988 None] Created volume successfully. Jul 11 18:20:34 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.630s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG oslo_service.periodic_task [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] Running periodic task VolumeManager._thread_info {{(pid=86932) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread count: 28 {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:20:34 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-4f51bb97-3d90-4876-ab72-558b52a6de87 None None] thread info: [<_MainThread(MainThread, started 128411631194240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86932) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-e841daa4-6571-4dab-ac17-94bb944b9a00-delete_volume" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-e841daa4-6571-4dab-ac17-94bb944b9a00-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:UPDATE=97,cinder:INSERT=28,cinder:SELECT=72,cinder:DELETE=8 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "cinder-quobyte-e841daa4-6571-4dab-ac17-94bb944b9a00" by "delete_volume" {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-e841daa4-6571-4dab-ac17-94bb944b9a00" acquired by "delete_volume" :: waited 0.016s {{(pid=86932) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f06d8-f552-495b-a0e9-b1792c56ecc8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:20:35 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:35 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 Jul 11 18:20:35 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:36 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00" returned: 0 in 0.724s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:36 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00 Jul 11 18:20:36 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:36 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a/volume-e841daa4-6571-4dab-ac17-94bb944b9a00" returned: 0 in 0.646s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-quobyte-e841daa4-6571-4dab-ac17-94bb944b9a00" released by "delete_volume" :: held 1.408s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG cinder.quota [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Created reservations ['d101147b-c67e-4dee-90fd-85c85ed2d6c5', 'ede4069d-802c-43af-b90c-bd7be039e090', 'f88c1d55-170f-4586-b07d-e59b3b909d34', '8460ddff-ae4a-4276-8c41-461499ff4409'] {{(pid=86932) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae': None} {{(pid=86932) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG cinder.volume.drivers.quobyte [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5d6af46-17a3-4a0d-a87c-b649c45f8eae'] {{(pid=86932) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86932) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:20:36 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:20:36 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a Jul 11 18:20:36 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:20:37 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 11 18:20:37 devstack cinder-volume[86932]: DEBUG oslo_concurrency.processutils [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7a57ddb6fae070eb4e0ceeb9304dbc7a" returned: 0 in 0.648s {{(pid=86932) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:20:37 devstack cinder-volume[86932]: DEBUG cinder.manager [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Notifying Schedulers of capabilities ... {{(pid=86932) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:20:37 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Deleted volume successfully. Jul 11 18:20:37 devstack cinder-volume[86932]: DEBUG cinder.coordination [None req-5818b919-bd93-4394-adc5-aa695dbed243 tempest-ProjectReaderTests-1186008988 None] Lock "cinder-e841daa4-6571-4dab-ac17-94bb944b9a00-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86932) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:20:46 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:20:47 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:INSERT=12,cinder:UPDATE=67,cinder:SELECT=33,cinder:DELETE=7 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}